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A STUDY OF THE RELATIONSHIP OF CER- 
TAIN COMPETENCIES TO SUCCESS IN 
TEACHING VOCATIONAL AGRICULTURE 


ANDREW PUMPHREY TORRENCE 
Tuskegee Institute 


SECTION I 
Statement of the Problem 


the Е PURPOSE of this study is to ascertain 
vocational nship between the success attained by 
petencies А др стени teachers and certain com- 
сив Poses at these vocational agriculture teach 
ment of nur In order to facilitate the achieve- 
ben iom pupone, four null hypotheses have 
guide in bci ed. These hypotheses serve as a 
ing what а the investigation, in determin- 
dering the d to collect, in classifying and or- 
ments nece ata, and in making the basic judg- 
hypothese Ssary in this study. The four null 
5 to be tested in this study are: 


1. Th i 
Шр, ae о statistically significant relation- 
etween a моя by coefficients of correlation, 
owledge pem em agriculture teacher's 
On and bi of technical agricultural informa- 
S success as a teacher. 


ti 


There і 
Bhip, aa s Statistically significant relation- 
etween a € by coefficients of correlation, 
Proficienc Ocational agriculture teacher's 
ipulative y in performing agricultural man- 
Skills and his success as a teacher. 
„өрө 
Ship, as m statistically significant relation- 
etween a own by coefficients of correlation, 
knowledge vocational agriculture teacher's 
mation Ве of professional educational infor- 
апа his success as a teacher. 


Th i 

Bi ue no statistically significant relation- 
се E Shown by regression equations, be- 

knowl vocational agriculture teacher's 

д edge of technical agricultural 4 


t Ma 
lon, proficiency in performing agriqulfpral; Eg 


manipulative skills, and knowledge of pro- 
fessional educational information and his 


success as a teacher. 


Definition of Terms 


The definition of words and phrases given be- 
low will generally apply wherever these words 
and phrases appear throughout this study. Wher- 
ever any of these terms are used in this study 
with meaning different from the definitions here 
given, the reader will be so informed. 


1. Competence—the level of efficiency, ability, 
or knowledge that one has achieved. 


2. Manipulative skills—the ability to use one's 
knowledge and intellect to perform tasks with 
the hands or by mechanical means. 


3. Null hypothesis—a supposition that observed 
effects are due to chance factors and not to 
statistically significant relationships. 


4. Professional education—that part of a teach- 
er's training that will give him an apprec i- 
ation of and a knowledge of how best to teach 
his subject and influence desirable changes in 
his students. Professional education would 
concern itself with such things as the place of 
the school in our society, child growth and 
development, child psychology, guidance and 
measurement in education, and princ iples 
and methods of teaching. 


5. Relationship—a connection or link between 


two or more factors. It means that altera- 
ions-in-one-oy more factors occur along with 


|. 2, aliggations;jn one or more different factors. 


XThe . ЖАШ чл irae | 
author wishes to express his sinc ге ended! ana ар е ЧК tolhany people whose assistance has 
W. T. Bjoraker, his major 


tant direction, encouragement, and inspira- 
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These changes may occur conversel y, or 
they may occur in harmony with each other. 


6. Teaching success—the degree to which a 
teacher of vocational agriculture uses desir- 
able means to attain desirable ends in dis- 
charging his duties as a teacher. 


7. Teacher training—those activities needed for 
assisting teachers or prospective teachers to 
secure the professional knowledge, abilities, 
understandings, and appreciations which will 
enable them to qualify for professional em - 
ployment or advancement in teaching voca- 
tionalagriculture. This training is general- 
ly given in accredited colleges or universi- 
ties where agricultural education is taught. 


8. Technical agriculture—the knowledge that 
one has concerning factual information on the 
production and management of 11 vestock, 
Crops, and soil. 


9. Vocational agriculture—a nation-wide, feder- 
ally aided program of Systematic instruction 
in agriculture and farm mechanics of less 
than college grade conducted in public schools 
ог classes for persons over 14 years of age, 
for the purpose of training present and pros- 
pective farmers for proficiency in far m i ng. 
This program in the individual state 5 and 
schools must be conducted in conformity with 
Congressional Vocational Education Acts. (1) 


Background of the Study 
——9— © he Study 


time. The latest of these is the Vocational Ed- 
ucation Act of 1946, commonly known as the 
George-Barden Act. These acts have been en- 
acted for the purpose of promoting and develop- 
ing vocational education through a plan for co- 
operation between the federal government and 
the states. Vocational education in agriculture 
was encompassed in the first enabling act and 
it has been recognized and included in each suc- 
ceeding act. 

This plan of cooperation for the development 
of vocational education is based upon two funda- 
mental ideas: (1) that vocational education is a 
matter of national interest and essential to the 
national welfare, and (2) that federal funds are 
necessary to stimulate and assist the states in 
making adequate provisions for such training. (1) 
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The primary aim of vocational education in 
agriculture is to train present and prospective 
farmers for proficiency in farming. Ithas been 
considered as one of the permanent phases of 
the public school program in rural areas. Voca- 
tional education in agriculture has been instru- 
mental in developing the Skills, abilities, infor- 
mation, attitudes, understandings, and working 
habits of rural people which will enable them to 
enter employment in agriculture, or to make 
satisfactory advancement infarming occupations. 
It also, presumably, makes а contribution toward 
the development of good citizens, including their 
health, social, civic, and cultural interests. 

Under a plan of Cooperation between state 
boards for vocational education and the United 
States Office of Education, vocational education 
in agriculture is a nation-wide, federally aided 
program of systematic instruction in agricul- 
ture and farm mechanics of less than college 
grade conducted in public schools or classes for 
those persons over 14 years of age who have en- 


the work of the farm or of the farm home. The 
instruction is given by qualified teachers of vo- 
cational agriculture who are employed on a 12- 
month basis so as to follow-up their instruction 
throughout the year by assisting individuals and 
groups with their farming programs on the indi- 
vidual student's farm. This providesa year- 


round, uninterrupted program of instruction in 
agriculture. 

The major objectives of vocational education 
in agriculture are to develop éffective ability to: 


1. Make a beginning and advance in farming. 
2. Produce farm commodities efficiently. 

3. Market farm products advantageously. 

4. Conserve soil and other natural resources. 
5. Manage a farm business, 

6. Maintain a favorable environment. (1) 


There are three well-recognized groups to 
be served by vocational agriculture, namely, 


ing, usually on the farm or asa farm work- 
er looking forward to full establishment 
as an independent farm operator. 

3. Adult farmers fully established as operat- 
ors either as owners or as tenants. 


Vocational education in agriculture has been 
nsidered as an integral part of Public secon- 
dary school education and contributes to the gen- 
eral objectives and Philosophy of such education. 
Ап examination of апу recognized set of secon- 
dary school objectives with the intention of 25- 
certaining what contributions vocational agricul- 
ture makes to them will readily prove the au- 
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thenticity of this claim. Cook (13) postulates 
how vocational education in agriculture provides 
many opportunities for the development of abili- 
ties essential to the seven cardinal principles of 
education. This writer made a study of **How 
the Vocational Agriculture Curriculum of Wis- 
consin Contributes to the Ten Imperative Needs 
of Youth as Listed by the Education Policies 
Commission. ” (45) Не charted the needs of 
youth which various vocational agriculture sub- 
jects help to satisfy, and found that the voca- 
tional agricultural curriculum of Wisconsin 
makes a very appreciable contribution to satis- 
fying these ten imperative needs. Alloftheim- 
perative needs get some contribution from vo- 
cational agriculture subjects, varying from a 
very little to considerable. Тһе methodology of 
teaching, the knowledge of the subject, and the 
teacher himself are major factors in getting the 
imperative needs of youth satisfied. 

Vocational agriculture has served to elevate 
the level of economic Stability, social stability, 
and general establishment of farm people in 
farming by teaching agriculture to high school 
farm boys, as well as by keeping the adult farm - 
ers aware of the latest and best scientific dis- 
соуегіев in farming. Without the instructional 
aid of this program, many young men would not 
have been able to begin or continue in farming 
Successfully. The more successful vocational 
agriculture teachers are, the more succes s ful 
farmers and farm communities will be in attain- 
ing desirable ends. This study is intended to 
reveal what relationship certain competencies 
have to the success of vocational agriculture 
teachers. 

One of the essential features is a good pro- 
gram of vocational education in agriculture is 
an adequate Supply of competent teachers. This 
Was recognized in the Smith-Hughes Act which 
Provided specific funds for the training of teach- 
ers and required that in order to use the money 
provided for the salaries of vocational teachers, 
а state must expend а Specified amount for the 
training of teachers. The George-Barden Act 
does not make a Separate authorization of funds 
for this Purpose, but it does state thatthe funds 
made available for the Several vocational fields 
(which includes vocational agriculture) may be 
used for assisting the States and Territories in 
fap. d) Ps adequate programs of teacher train- 
ing. 

Why some vocational agriculture teachers 
meet with great success while others attainonly 
mediocre success or fail is of great importance 
to teachers themselves, to state supervisors of 
vocational agriculture, to teacher training insti- 
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tutions, to high school vocational agriculture 
students, and to farmers. If the success of vo- 

cational agriculture teachers could be success- 

fully predicted before or shortly after he enters 
the field of teaching, it would save the time, en- 
ergy, and resources of the teacher and all who 

help train him. More important, it would pro- 
tect farming areas from ineffective vocational 

agriculture teachers. - 

The number ої recent studies attacking yg 
ious phases of vocational agriculture tea cher 5 
success gives evidence of the gravity of this prob- 
lem.* It is easily recognized that unless voca- 
tional agriculture teachers are effective, the 
whole program of vocational agriculture can be 
of little value. Some studies concerned with 
causes for discontinued departments of voca- 
tional agriculture in high schools were reviewed 
by this writer. Three of these studies (35, 36) 
listed ineffective teaching as being one of the 
main causes for the vocational agriculture pro- 
gram being dropped from the high schoolcurric- 
ulum. 

In order to increase the effectiveness of vo- 
cational agriculture teachers, we must first dis- 
cover on what their success hinges. Many of the 
studies reviewed by this writer deal with pre- 
Service training of teachers of vocational ag- 
riculture.. Although this study will reflect the 
significance of pre-service training, itis not 
primarily a pre-service training study. Itdeals 
directly with the in-service teachers and there- 
fore is considered a contribution that has not 
been made previously. Е 

шап өзінік entitled **Impact of Research in 
Agriculture,” Byron T. Shaw (34) points өш 
agriculture faces a tremendous job іп the nex 
25 years. He states that “our population is D 
growing at the rate of 25 million a year, and the 
Census Bureau estimates that by 1975, under 
moderately favorable conditions, it will reach 
190 million. This means that American farmers 
will have to produce about 30 percent more by 
1975 if they are to provide adequately for all our 
people.” Most good land is already taken, зо 
our greatest opportunity for meeting this t 
creased population problem is in better use 0 
the land we already have for farming purposes. 
This assumes greater efficiency in produc tion 
on farms and improved distribution, utilization, 
and marketing after products leave the farm. Mr. 
Shaw writes, ‘‘The job ahead of us is to increase 
production wherever possible, to preven t de- 
clines in production, to cut waste and spoilage 
of goods during handling, and marketing, and 
in the home, and to make better use of agricul- 
tural products". 


*See Chapter IT, "Review of Related Research," in original thesis on file in the Library of the Univer- 


Sity of Wisconsin, 


4 JOURNAL ОҒ EXPERIMENTAL EDUCATION 


This article is principally concerned with re- 
Search in technical agriculture and technical 
farming, however, we can easily infer from it 
the need for efficient teachers of vocational ag- 
riculture. Vocational agriculture teachers, 
along with other rural education agencies, have 
the tremendous responsibility and obligation not 
only to funnel the results of agricultural re- 
search to every farmer and farm home, but al- 
50 to interpret these results so that they might 
be understood, appreciated, and profitably util- 
ized. 
= In 1900 each American farmer produced 
enough to feed eight people. Today he produces 
sufficiently to feed 16 people, butitis estimated 
that by 1975 he will have to produce enough to 
feed 21 people. The successful vocational agri- 
culture teacher will do much to help the farmer 
accomplish this task. It is hoped that as a re- 
sult of this study, we will have some indications 
of whether or not certain competencies of voca- 
tional agriculture teachers are related to their 
Success. 


Aspects of the Problem to be Investigated 


While the purpose of this study is to deter- 
mine the relationship between the succes 5 at- 
tained by vocational agriculture teachers andcer- 
tain competencies possessed by these teachers, 
more specifically, it will seek to find answers 
to the following questions: 


1. What relationship exists b 
al agriculture teacher’s k 
nical agricultural inform 
as a teacher? 


etween a vocation- 
nowledge of tech- 
ation andhis success 


2. What relationship exists between a vocation- 


al agriculture teacher's proficiency in per- 
forming agricultural manipulative skills and 
his success as a teacher? 


. What relationship exists between а vocation- 
al agriculture teacher's knowledge of pro- 


fessional educational information and his suc- 
сев5 as a teacher? 


4. What relationship exists between a vocation- 
al agriculture teacher's knowledge of tech- 
nical agricultural information, proficiency in 
performing agricultural manipulative Skills, 
and knowledge of professional educational in- 
formation as a composite and his success as 
a teacher? 


Significance of the Study 


A perusal of the literature indicates that the 
competencies of vocational agriculture teachers 
that are being investigated in this study have not 
been assessed previously in relation to the suc- 
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cess of vocational agriculture teachers. Little 
is known as to why some vocational agriculture 
teachers seem to be more successful than oth- 
ers. It is hoped that this study will reveal what 
relationships the above competencies have on 
the success of these teachers. This study should 
be a valuable tool for determining pre-service 
and in-service training needs of vocational agri- 
culture teachers. It will show whether or not 
there are wide-spread incompetencies of certain 
technical information, manipulative skill abil- 
ities, and professional knowledge of vocational 
agriculture teachers in Wisconsin, andhow they 
relate to the success of these teachers. 

Wisconsin has long been regarded as a state 
of high achievement in agriculture and agricul- 
tural education. It is hoped that this study will 
set a pattern of procedure that can be followed 
in other states, and that it will permit other 
states making such a Study in the future to com- 
pare their results with the findings of this study. 

Lastly, this whole field of vocational agricul- 
ture teacher success is still in need of muchser- 
ious research. This Study will serve as a fore- 
runner for subsequent vocational agriculture 
teacher-success studies to be conducted at the 
University of Wisconsin. 


SECTION II 
DESIGN OF THE STUDY 


THE COMPETENCIES of vocational agricul- 
ture teachers that are to be measured in this 
Study are in the areas of technical agriculture, 
manipulative farm skills, and professional edu- 
cation. 

The group to be studied willbea randomsam- 
ple of sixty vocational agriculture teachers who 
teach in one man vocational agriculture depart- 
ments of public high schools located in approx- 
imately the southern two-thirds of the state of 
Wisconsin. 

_ Teacher success will be determined from rat- 
ings given to the vocational agriculture teachers 
by people who are in a Position to know of the 
work of these vocational agriculture teachers. 
These ratings will be furnished by state super- 
visors, principals, pupils, and farmers in the 
local school and community in which each teach- 
er teaches. 


Description of the Subjects 
he subjects 


n this investigation were 
xty high school teachers 
vocational agriculture in one 

teacher departments located in approximately 
the southern two-thirds of the State of Wiscon- 


these teachers were 


wa, Clark, Marathon, Shawano, Brown, and 
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Kewaunee counties and the southern limits of 
the state of Wisconsin. (See Figure 1.) The to- 
tal population from which these teachers were 
drawn did not include vocational agriculture 
teachers who teach in vocational schools, and 
it did not include vocational agriculture teach- 
ers who teach in departments of vocational agri- 
culture that have two or more teachers. 

All of the vocational agricultureteachers who 
Ге in one-man departments located within 
=. та described above were listed alphabetic- 
=: a T name. Numbers were assigned to this 
e abeticallisting, and a sample of 60 teach- 
nat fi e drawn by the use of Fisher and Yates’ 

of random numbers. (19) There were 217 
teachers in the total population. 
E Sixty teachers chosen at random, 16 
temo ently enrolled in summer school at the 
и i ү of Wisconsin. There were 14 other 
бә. ie Yo prm d teachers enrolled in sum- 
n 001 at the University who taught in on e- 
cit bey m located in the area described 
e x BR assigned numbers did not fall 
а kg опа Selection. It was decided that if 
ама. ра did not differ significantly 
UE 6 teachers who were drawn in the 
че Sample, they too could be оѕедіп Ше 
хау as а part of the random group. 

Е to that decision, the tvo groups 
n rue и respecttothe following: (1) 
7-4 ) training, (3) rearing (whether or not 
ts € were reared on a farm), (4) experience 
а pos agriculture, (5) total student enroll- 
i (6) t igh Schools in which teachers taught, 
речі тА otal vocational agriculture department 
AUEN w^ high school in which teachers 
in able T. e results of this analysis are shown 
wu iue of these teachers is very simi- 
al едис, ап һауе а В. S. degree in agricultur- 
eius lon or its equivalent, and have done 
4 ж. graduate work. One of the teachers 
P tee = S. degree in agricultural education. АП 
ұйық еле ехсері опе меге геагедопа 
i ann n Me who was not has owned a farm 
ка Statistical significance of the difference 
нер аку (24) for те two groups was cal- 
ii мено) 5 the age, experience in teaching agri- 
оса rts high school enrollment, and total 
Selec nal agriculture department enrollment 
"і ns. It was decided thatif these differ- 
о. е not significant at or below the . 05 
he probability, it could be assumed that 

se two groups were a part of the same total 
population. All differences proved non-signifi- 
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cant with the greatest difference being at the 15% 
level of probability for the total high school en- 
roliment column. Other differences were atthe 
90% level for age, the 65% level for experience 

in teaching agriculture, and the 40% level of 

probability for the total vocational agriculture 
department enrollment factors. 

Since the differences in these two groups are 
not significant at the levels describedabove, and 
since the 16 teachers were randomly drawn from 
the total population, it was assumed that the 14 
teachers who were in summer school but not 
drawn in the random selection could be cons id- 
ered a part of the randomization, and they were 
therefore added to the subjects used in this study. 
This gave a total of 30 teachers on the Universi- 
ty campus to be used in the study, and it left 30 
additional teachers to be selected who were not 
enrolled in summer school at the University of Wis- 
consin. The remaining 30 teachers participating 
inthis study who werenotenrolledin summer 
school were chosenas their assigned numbers ap- 
peared іп Ше random selection prov iding they 
were available for the testing program designed 
forthisstudy. Allofthe30teachersinthe state 
whose assigned numbers were drawn in the ran- 
dom selection were available for testing except 
six. One of these was sick, the other five were a- 
way оп vacation. When it occurred that six of the se- 
lected teachers were notavailable for testing, the 
six teachers assigned to the next numbers appear- 
ing in the table of random numbers were chosen. 


Description of Data Gathering Devices 


1. Technical Agriculture Information 

Technical agriculture competency was meas- 
ured by administering tests of factual informa- 
tion in seven technical agriculture fields. These 
tests were in the areas of agronomy, dairy cat- 
tle, farm management, horticulture, poultry, 
soils, and swine. Three of the tests were con- 
structed by the writer with guidance and super- 
vision from an expert in the field at the Univer- 
sity of Wisconsin. * Three tests were adap ted 
from a battery of tests on animal enterprises by 
Ivan G. Fay, State Supervisor of the Veterans 
On-Farm Training Program in Wisconsin. This 
battery is entitled "Мазіегу Tests in Animal 
Husbandry’’, and is published by the Interstate, 
Danville, Illinois. Experts at the University of 
Wisconsin also assisted in the adaptation of these 
tests for use in this study. ** Professor Edward 
J. Graul of the Soils Department of the Univer- 
sity of Wisconsin prepared the test in soils. Com- 
petency in feeds and feeding was determined by 


Experts giving guidance and supervision to the construction of these tests were: Professor Re He Andrew 


in agronomy; Professor Donald В. Mitchell in Farm Management; and Professor Malcolm Ne 


ture, 


“Experts assisting in this adaptation were: Professor James We Crowley in dairy husbandry; 


Dana in horticul- 


у; Frofessor Rob- 


ert H. Grummer in animal husbandry; and Professor James С. Halpin in poultry. 


COMPARISON OF THE 16 VOCATIONAL AGRICULTUR 


TABLE I 


E TEACHERS ENROLLED IN SUMMER SC HOOL AT 


THE UNIVERSITY OF WISCONSIN WHO WERE DRAWN IN THE RANDOM SAMPLE SELECTION AND 


THE 14 TEACHERS WHO WERE NOT 

Summer School Mean Years Mean Total 
Teachers Who College Reared Mean Age Experience Mean Total Vocational 
Participated in Degrees ona of Teach- in Teaching High School Agri. Dept. 
Study N Held Farm ers (years) Agriculture Enrollment Enrollment 
Drawn in ran- 16 16 with 16 32.69 7.6 256. 25 89.12 
dom sample B.S. de- 
Selection gree or 

equivalent 
Not drawn in 14 14 with 13 32. 86 8.5 443. 71 81. 36 
random sam- В.5. de- 
ple selection gree or 

equivalent; 

1 with M. S. 

degree 


копуопая тутмяипняахя ло тукапог 


сс стол) 
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FIGURE 1 


THE AREA FROM WHICH THE VOCATIONAL AGRICULTURE TEACHERS PARTICIPATING IN 
THIS STUDY WERE CHOSEN, AND THE DISTRIBUTION OF THE SCHOOLS IN WHICH 
THEY TAUGHT 


TAYLOR 
MARATHON 
CLAR E 
EAU CLAIRE 
ӨСУІ 


WAUPACA * И 
"== 


Се ГАШ MANITOWOC 
WINNEBAGO а Ua 
(та УК 
ñ 
е 
\ да 
FOND DULACEY элё 


VERNON 


Note: The heavy black line indicates: the upper limits of the State from which participants in this 
Study were chosen. 
б black dots indicate the location of Ше 60 schools in which participants in this study 
ught. 
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the incorporation of questions on this topic into 
the animal enterprise tests. 
In order to check the comprehensiveness of 
these tests, their coherence, and the approx- 
imate time required to take them, the original 
test drafts were administered to 11 upper class- 
men in the Department of Agricultural Educa- 
tion at the University of Wisconsin. (See Test 
drafts, Appendix A.)* In tabulating the respon- 
ses to this *'trial гип” testing, it was discov- 
ered that certain questions had to be deleted or 
revised because of inappropriateness. Some 
sections of the tests were revised inorder to 
give consistency to the question design, to add 
Speed in taking the tests, and to facilitate tabu- 
lation. The revised technical agriculture infor- 
mation tests were used in this Study. (See Ap- 
pendix B.) There was no time limit for c om- 
pleting these tests. 


2. Agricultural Manipulative Skills Information 
Competency in agricultural manipulative 
Skills was measured by a survey (see Appendix 
C) of manipulative farm skills completed by each 
subject. This survey of skills was adapted 
from a survey used by Rhoad (32) to m easure 
the comprehensiveness of abilities in technical 
agriculture attained by prospecti 
vocational agriculture in 


У, Swine, corn, 


І llgrains, garden- 
ing, potatoes, fruit growing, concrete, electri- 


fication, farm machinery and power, erosion 
control, home beautification, and farm plumb- 
ing. 

Each question in the Survey was answeredon 
a five-point rating scale as follows: 5) ехсе1- 
lent, 4) good, 3) average, 2) poor, 1) no exper- 
ience. A high score indicated a high degree of 
proficiency in performing the skill. Definition 
of the terms (see Appendix C) usedinthe rating 
scale were read by each subject so thatall would 
have the same conception of the meaning of these 
terms in rating themselves. 

А memorandum (see Appendix C) to each sub- 
ject asked him to be objective in rating himself, 
to take his time (there was notimelimit on this J 
and to rate himself on each item in the survey. 


3. Professional Education Information. 
The measure of professional education com- 
petency of vocational agriculture teachers was 


*All references to Appendices will be found in original thesis on file in Libr 


sin, 
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accomplished by administering the Professional 
Information section of the 1951 edition of the Na- 
tional Teacher Examinations to all teacherspar- 
ticipating in this study. Because oí the highly 
confidential nature of these tests, and pursuant 
to directions from Mr. Arthur L. Benson, Di- 
rector of Teacher Examinations of the Educa- 
tional Testing Service, reproduction of these 
test questions cannot be included in this s tudy. 
However, numerous references to the National 
Teacher Exaininations can be found ia the liter- 
ature (20, 16, 33, 43), dating back to 1940 when 
they were first given. 

The National Teacher Examinations are pre- 
pared and administered annually by the Educa - 
tional Testing Service. They consistofa battery 
of tests designed to measure the professional 
background, mental ability, and general cultur- 
al knowledge of candidates for teaching posi- 
tions (43). Only the Professional Information 
Section of these tests was used in this study. Al- 
though this section yields a single Score, it is 
composed of four parts. Each part of the 1951 
edition of the Professional Information section 
of the test is timed; the total time allotted for 
taking this section is 75 minutes. Thereis a to- 
tal of 105 questions in this section of the test. 
The four parts of this section of the test, the num- 
ber of questions ber part, and the time allotted 
per part are shown in Table II. All questions 
were of the objective type, consisting of short 
answers involving multiple-choice responses. 

Since these examinations are revised annual- 
ly, the reliabilities cf the various tests vary 
Slightly from year to year. The objective of the 
Educational Testing Service is to maintain mini- 
mum Kuder-Richardson reliability coefficients 
of .85 for the Professional Information section 
and other sections of the tests. Because of the 
analysis data available to the Edu- 
cational Testing Service in constructing the tests, 
instances where they fail to meet this objective 
are rare. According to Mr. Benson, no part- 


Score normative data are available for the 1951 
edition of this test 


is a leaflet of the 
the 1951 nation-w 
al Teacher Exam 
ished by Мг. Benson, give 


4. Criteria of Success 

The measure of teacher Success was deter- 
minedby ratings given to vocational agriculture 
teachers by state Supervisors of vocational agricul- 
ture, principals, Pupils, andfarmers in the local 
School and community in which each teacher taught. 


ary, University of Wiscon- 
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TABLE II 


THE PARTS OF THE PROFESSIONAL INFORMATION SECTION OF THE 1951 EDITION 
OF THE NATIONAL TEACHER EXAMINATIONS, THE NUMBER OF QUESTIONS 
PER PART, AND THE TIME ALLOTTED FOR TAKING EACH PART 


Parts of Professional Informa- No. of Time Allotted 
tion Section of 1951 Edition of Questions for Taking 
National Teacher Examination per Part Each Part 


PartI, Education as a 7 
Social Institution 21 15 minutes 


Part II, Child Development , 
and Educational Psychology 28 20 minutes 


Part III, Guidance and Meas- | 
urement in Education 28 20 minutes 


Part IV, General Principles я 
and Methods of Teaching 28 20 minutes 


Total 105 75 minutes 
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The state supervisor of vocational agricul- 
ture in Wisconsin and his staff cooperatively 
gave a rating to each teacher used in this study. 
They used a five-point rating scale as follows: 
5) excellent, 4) good, 3) average, 2) below av- 
erage, and 1) poor. А high score indicated a 
high rating; a low score indicated a low rating. 

А short form of the Wisconsin Adaptation of 
the M-Blank (see Appendix E) was used by the 
principals to rate the vocational agriculture 
teachers in their schools. Тһе ratingunderthe 
item “General Evaluation" was used inthis 
Study. The five-point scale and the indica- 
tions of the ratings were the sameas those used 
for the supervisors. 

An adaptation of a form used by Anderson (3) 
was used in this study to secure pupil ratings 
of vocational agriculture teachers. Mr. Ander- 
Son had adapted his pupil reaction to instruc- 
tion form from a pupil evaluation device devel- 
оред by Bryan. The all inclusive rating (see 
Appendix E) was the score used in this study. 
The five-point scale for this all inclusive га(- 
ing was: 5) best fifth, 4) second fifth, 3) mid- 
dle fifth, 2) fourth fifth, and 1) poorest fifth. 
A high score indicated a high rating; anda low 


i Б scale (see Appen- 
dix F) was developed and administered to 15 


(item 6) was the score used in this investigation. 
The five-point scale and the indications of the 
rating were the same as those used for the su- 


Securing the Data 
еше ИР ла 


1. Competencies of Vocational Agriculture 
Teachers 
Competencies of vocational agriculture teach- 
ers were measured by administering seven tests 
on factual information in technical agriculture, 
by administering a Survey of manipulative skills 
in agriculture, and by administering a test on 
professional education information to the teach- 
ers participating in this study. Thirty of the 
participating teachers were enrolled in the 1953 
summer school session at the University of Wis- 
consin. These several tests and the man- 
ipulative farm skills survey were administered 
to these teachers in a group on the campus of 
the University of Wisconsin in July, 1953. The 
remaining 30 teachers participating in this study 
were tested singly or in groups of twoatthe high 
schools in which they taught. The tests were 
administered to these teachers in July and Aug- 
ust, 1953. Because of the security hazard in- 
volved in administering the highly confidential 
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professional information examination, and inac- 
cordance with an agreement with Mr. Benson, 
Director of Teacher Examinations, Educational 
Testing Service, these tests were administered 
only in the presence of the writer, and under 
his continued supervision. 


2. Success of Vocational Agriculture Teachers 

Teacher success was determined from rat- 
ings given to the vocational agriculture teachers 
by state supervisors of vocational agriculture, 
principals, pupils, and farmers. Alist of the 
teachers participating in this Study was given to 
the state supervisor of vocational agriculture in 
September, 1953. In October, 1953, the state 
supervisor and his staff completed a cooperative 
rating of each teacher on the lists, andthese rat- 
ings were used in the study. 

In May, 1953, high school principals were 
sent a form letter (see Appendix E) asking them 
to rate their vocational agriculture teacher, and 
to have five officers of the local FFA rate him 
on forms enclosed for that purpose. These com- 
pleted rating scales were returned in s tam ped 
self-addressed envelopes that were furnished by 
the writer. 

Five farmer ratings were used for each voca- 
tional agriculture teacher participating in this 
study. The names and addresses of the farmers 
were secured from a general information sheet 
(see Appendix C) that each Participating teacher 
completed at the time that he took the tests. Each 
teacher listed 10 farmers in his local school 
community. The five most cooperative farmers, 
according to the vocational agriculture teacher, 
were sent a form letter (see Appendix G) in Aug- 


re furnished by the 


Treatment of the Data 
te Data 


As indicated ea 
technical agricult 
ers of vocational 
this study. Th 
ronomy, dairy 
culture, poultry, 


or areas of farm skills. 


rating of the efficiency of each teacher by four 
groups of raters as follows; 


1. Rating of teacher by state supervisors. 
2. Rating of teacher by principal on the Wiscon- 
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sin Adaptation M-Blank (short form). 

3. Rating of teacher by pupils on an adaption of 
the Pupil Reaction to Instruction form used 
by Harold M. Anderson. 

4. Rating of teacher by farmers on a Farmer 
Rating Scale. 


Raw scores were used in all of the tabula- 
tions. АП of the individual scores on each test 
and on each enterprise or area of manipulative 
farm skills survey were tabulated. After this 
was done, the following composites were made 
for each participating teacher: 


1. Composite score made on the seven tests of 
technical agriculture. (Scores made on the 
four parts of the professional information 


test were originally recorded as a composite 
Score.) 


2. Composite score made on the manipulative 
farm skills survey. 


3. Composite score made on the seven tests of 
technical agriculture and the manipulative 
farm skills survey. 


4. Composite score made on the seven tests of 


technical agriculture and the professional in- 
formation test. 


5. Composite score made on the manipulative 


farm skills survey and the professional infor- 
mation test. 


6. Composite score made on all testing devices; 
Seven tests of technical agriculture manipu- 
lative farm skills survey, and the profession- 
al information tests. 


Each rating on each participating teacher 
was tabulated. The principal ratings were se- 
cured as a single score with a possible hi gh 
rating of five and a possible low rating of one 
for each teacher The supervisory rat ings 
Were secured ina similar manner. The five 
pupil ratings were combined to make one score 
With a possible high rating of twenty-five and a 
possible low rating of five for each teacher. 
The five farmer ratings were treated the same 
aS were the five pupil ratings. Тһепіһергіп- 
cipal and Supervisory rating scores were adjust- 
ed to give them equal weight with the pupil and 
farmer rating scores. The adjustment was ac- 
complished by multiplying five times the prin- 
cipal’s rating score and five time the supervis- 
ог в rating score. This gave the principal and 
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supervisory rating scores a possible high of 
twenty-five and a possible low of five for each 
teacher, thereby, equating these scores with the 
pupil and farmer rating scores. Using these ad- 
justed scores, the following composites were 
made for each participating teacher: 


1. Composite supervisory and principal 
rating score. 

2. Composite supervisory and pupil rat- 
ing score. 

3. Composite supervisory and farmer rat- 
ing score. 

4. Composite principal and pupil rating 
score. 

5. Composite principaland farmer rating 
score. 

6. Composite pupil and farmer rating 
score. 

7. Composite of the supervisory, princi- 
pal, pupil, and farmer ratings. 


Scores made on the several tests usedin this 
study were intercorrelated. Scores made on the 
various enterprises or areas ofthe manipulative 
farm skills survey were intercorrelated, and in- 
tercorrelations were secured among efficiency 
rating scores. Intercorrelations were secured 
among the test scores and each efficiency rating, 
between each test score and all possible combin- 
ations of the ratings, as well as between a com- 
posite of the test scores and all possible combin- 
ations of the rating scores. This same proced- 
ure was followed in running intercorrelations 
among the manipulative farm skills survey and 
all Ше several ratings. Finally, intercorrela- 
tions were secured among composite scores 
made on the seven tests of technical agriculture, 
the manipulative farm skills survey, the profes- 
sional educational information test, and the ef- 
ficiency ratings. ; 

From composite scores made on the tests in 
technical agriculture, the manipulative farm 
skills survey, and the professional educational 
tests, multiple regression techniques will beem- 
ployed to develop equations for predic ting the 
success of the vocational agriculture tea c her. 
Composites of ratings will be used as the criter- 
ia of success. Finally, from the scores made 
on selected tests in technical agriculture, Se- 
lected enterprises in the manipulative farm 
skills survey, and in the professional education- 
al information test, multiple regression tec h- 
niques will be employed to develop e quations 
for predicting the success of the vocational ag- 
riculture teacher. Composites of ratings will 
be used as the criteria of success. 
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SECTION Ш 
ANALYSIS OF DATA 


IN THIS SECTION, the statistical treatment 
of the data will be presented. Occasional refer- 
ence will be made to tables andto selected books 
for more detailed discussions of the data and 
methods employed in conducting this study. 

The Pearson product moment coefficient of 
correlation (30) will be used in this study to in- 
dicate linear relationships existing between var- 
ious sets of competency scores; between var- 
ious sets of success rating scores; and between 
various competency and rating scores. * 

Correlational data used in this study will be 
summarized with the use of observation, statis- 
tical significance of correlations (24), and re- 
gression equation techniques (12, 44). Correla- 

tions that are not significant at or below the 59, 
levelof probability will not be considered sta- 
tistically significant in this study. 

This section will be divided into five parts. 
Part one will deal with the percentages of right 
answers made on the tests in technical agricul- 
ture, the percentage scores made on the manip- 
ulative farm skills survey, and the percentages 
of right answers on the test in professional edu- 
cation. 

Part two will deal with the intercorrelations of 
success rating scores. Part three will be con- 
cerned with the intercorrelations of competency 
scores, while part four will deal with the cor- 
relations between competency scores and suc- 


cess rating scores. In part five the prediction 
of success will be considered. 


Competency Scores and Success Rating 
Score Percentages 
aS слешанев 


1. Test in Technical Agriculture 
All tests in technical agriculture were de- 
signed and developed in similar manner. (See 


Section П.) They all deal with basic and fundament- 
al factual material іп their respective areas. Be- 


cause of these similarities, the various tests of 
technical agriculture are assumed to have ар - 
proximately equal difficulty and equal basic un- 
derstanding requirements. 

Table Ш indicates that the highest individual 
percentage score made on the test in technical 
agriculture was 96.3, made on the dairy cattle 
test. The mean percentage score on the dairy 


“The formula vsed in this computation was г = 
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cattle test was 75.3. The only mean percentage 
score that was higher than this was made on the 
poultry test. The mean percentage scoreon the 
poultry test was 76.1. 

The lowest individual percentage score, 32.9, 
was made on the soils test. The mean percent- 
age score on the soils test was 63.5. The only 
mean percentage score that was lower than this 
was made on the farm management test. The 
mean percentage score on the farm manage- 
ment test was 60.7. 

Higher individual percentage scores were 
made on the animal enterprise tests, including 
dairy cattle, poultry, and swine, than was made 
on any other technical agricultural test. Also, 
the animal enterprise test shows a higher low 
percentage score than any other single test 
except the agronomy test. The low percentage 
Score on the agronomy test was 59.2. Except 
for agronomy and horticulture, with mean per- 
centage scores of 75.1 and 75.0 respectively, 
the mean of the animal enterprise percentage 
Scores was higher thanit was for any other single 
test. 

Farm management and soils are rather simi- 
lar with respect to their mean, high, and low 
percentage scores. Theyhavelower percentages 
of right answers in all three categories than any 
other single test. Soils has a higher mean and 
high score percentage right than farm m a nage- 
ment, while farm management has a higher low 
Score percentage than soils. 

Agronomy and horticulture are very similar 
with respect to their mean, high, and low per- 
centage scores. 

On the basis of the assumption thatthese tests 
in technical agriculture have approximately 
equal difficulty and equal basic understanding re- 
quirements, these percentage scores have the 
following indications: (1) that vocational agri- 
culture teachers in Wisconsin, from whom this 
Sample was chosen, have a better knowledge of 
basic facts in animal enterprises than they have 
in other farming enterprises investigated in this 
Study; (2) that vocational agriculture teachers in 
Wisconsin, from whom this sample was chosen, 
have less knowledge of basic facts in soils and 
farm management than they have in other areas 
of farm endeavor investigated in this study, (3) 
that vocational agriculture teachers in Wiscon- 


sin, from whom this sample was chosen, have 
less knowledge of basic facts in agronomy and 
horticulture than t 


hey have in animal enterprises- 


МУХҮ - 2X. sy 


V[NZX* - ($? NEY? -(zyji] Mere were three as- 


sumptions made when computing these correlations. They were: 


(1) a linear relationship existed between 


š ie ted had normal distributions, and ine best 
variables, (?) all the variebles correlat j зі ; and (3) a line 

Em a p when the sum of the squares of the deviations is а minimum. Assumptions one and two were 

5. = the basis of actual inspection of the data. Assumption three is based on a principle generally 
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accepted by mathematicianse 
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TABLE III 


AND LOW SCORES MADE BY TEACHERS OF AGRICULTURE ON THE 


VARIOUS MEASURES E 


XPRESSED AS PERCENTAGES 
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Mean High Low 
Scores Score Score 
I. Tests in Technical Agriculture 
A. Agronomy 75.1 88.8 59.2 
B. Dairy Cattle 15.3 96.3 51,2 
C. Farm Management 60.7 13.5 42.6 
D. Horticulture 15.0 88.9 57.1 
E. Poultry 76.1 92.5 60.4 
F. Soils 63.5 79.3 32.9 
С. Swine 74.8 91.0 52.6 
Н. Composite of all technical 
agriculture tests 71.8 80.8 61.0 
П. Tests in Professional Education 40.4 13.3 19.0 
II.  Manipulative Farm Skill Scores 
A. Dairy and Beef Cattle 70.0 93.3 41.3 
B. Poultry 56.2 88.0 32.0 
C. Swine 11.2 100.0 45.0 
D. Corn 67.4 100.0 38.0 
E. Meadow апа Pasture 69.6 96.0 46.0 
F. Small Grain 56.6 91.4 31.4 
G. Gardening 52.3 85.0 25.0 
H. Potatoes 10.2 88.0 20.0 
I. Fruit Growing 67.8 100.0 44.0 
J. Concrete 61.4 90.0 30.0 
K. Electrification 61.1 100.0 34.3 
L. Farm Machinery and Power 60.0 99.2 31.5 
M. Erosion Control 51.4 100.0 20.0 
N. Home Beautification 68.5 100.0 46.7 
О. Farm Plumbing 66.5 100.0 35.0 
P. Composite of Manipulative Farm Skills 62.0 91.0 40. 6 
IV. Composite of Individual Ratings of Teacher 
Success 85.0 100.0 61.7 


TABLE IV 


INTERCORRELATIONS OF INDIVIDUAL CRITERIA RATINGS OF VOCATIONAL AGRICULTURE 
TEACHER SUCCESS 


Principal Farmer Supervisory Composite 
Pupil „443 ‚316 „320 „845 
Principal, „307 ‚501 . 640 
Panier .488 „715 
Supervisory .644 


ИИ 
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However, their knowledge of basic facts in agron- 
omy and horticulture seem greater thantheir 

knowledge of basic facts in soils and farm man- 
E c composite percentage of right an- 

swers made on all tests in technical agriculture 
was 71.5. There is no normative data available 
as yet on these tests, and no acceptable criter- 
ion was found for evaluating this score. 


2. Test in Professional Education : 
Competency in professional education. was 
measured by administering the 1951 edition of 
the professional information section of the Na- 
tional Teacher Examination to all teachers who 
participated in this study. (See Section H.) 

Comparing the mean percentage score that 
the agriculture teachers made on this test (see 
Table III) with the mean scores and perc en tile 
ranks shown in Appendix D, it appears that the 
vocational agriculture teachers participating in 
this study are less well professionally informed 
than were the teachers taking this examination 
in 1951. However, this comparison must be 

qualified and considered in terms of the number 
of people taking the national administration of 
the test in 1951 as compared to the number of 
teachers used in this study. 

This comparison can also be qualified in 

terms of the importance of this test to the indi- 
vidualteacher. Scores made on this test dur- 
ing the national administration of it appear very 
important to the person taking the test. Some 
School Superintendents and boards of education 
require teaching applicants to submit scor es 
made on the National Teacher Examinations to 
be evaluated as a part of their application. А1- 
50, the National Teacher Examinations are used 
ав comprehensive examinations Тог undergrad- 
uates and as qualifying examinations for grad- 
uate students in some colleges. Because of the 
great importance of making high scores on the 
test, people taking the national administration 
of it in 1951 probably made Special study &nd 
reviews of educational principles in preparation 
Íor taking the test. No such special prepara- 
tion was made by the teachers participating in 
this study. 

There is no data available for comparing 
scores made on the professional educational test 
by vocational agriculture teachers participating 
in this study with scores made on the same test 
by other vocational agriculture teachers. How- 
ever, there is data available that seem to indi- 
cate that vocational teachers tend to make lower 
scores on professional educational test than do 

teachers of academic subjects. Table V of the 
flet in Appendix D indicates that industrial 
lea. iors and home economics majors who 
en vM 946-50 national administrations of the 
-- made lower mean scores than did most 
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people who took the test during those years and 
who expressed teaching preferences other than 
in vocational subjects. 


3. Manipulative Farm Skills 

The manipulative farm skills score was se- 
cured with the use of a self-rating survey (see 
Section II), so the human factors inherent in rat- 
ing oneself must be considered in analyzing these 
Scores. Definition of terms used in the rating 
scale (see Appendix C) accompanied each survey 
So that all participating teachers wouldhave sim- 
ilar understandings of term meanings and there- 
by reduce some of the subjectivity. 

There does not appear to be any particular ге- 
lationship among the mean, high, and low per- 
centage scores made on the various enterprises 
in the manipulative farm Skills survey. This 
would indicate a rather wide diversity of individ- 
ual competencies in performing agricultural 
Skills. 

Swine, which had the lowest mean percentage 
Score of the animal enterprise tests under test 
in technical agriculture above, has the highest 
mean percentage score of the animal enter- 
prises under the manipulative farm skills sur- 
vey. Dairy and beef cattle have the second high- 
est mean percentage score of the animal enter- 
prises under manipulative farm skills, and poul- 
try, which had the highest mean percenta ge 
Score of the three under technical agricultural 
tests, has the lowest mean percentage score un- 
der manipulative farm skills. Judging by tests 
and skills used in this Study, this would indicate 
that there is very little relationship between 
one's knowledge of factual information in animal 
enterprises and his ability to perform animal en- 
terprise skills. Table V, which shows intercor- 
relations of competency scores Supports this an- 
alysis. This table Shows that scores made on 
the animal enterprise tests of technical agricul- 
ture have almost no correlation with the scores 


made on the animal enterprise mani pulative 
Skills. 


Intercorrelations of Rating Scores 
is ot Rating Scores 


The intercorrelations of individual criteria 
ratings can be seen in TableIV. Similar in- 
Structions were Біуеп each rater, and judging 
from the responses to the request for ratings, 


used in the s 
that the ratings given each 
was a valid and reliable op 

The Supervisory and pr 
more closely correlated t 
ings. The Supervisory aj 
the second most closely 
while the principal and f 


; it is assumed 
participating teacher 
inion of the rater. 
incipal ratings are 
han any other two rat- 
nd farmer ratings are 
Correlated ratings 
armer ratings are the 
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lowest correlated ratings. АП of Ше correla- 
tions are statistically significant. Thatis, the 
positive relationships that are indicated by the 
correlations are not due to chance alone. 


Intercorrelations of Competency Scores 


1. Test in Technical Agriculture 

Among the technical agricultural tests are a 
considerable number of statistically significant 
correlations; some are higher than others. Ta- 
ble V shows that the highest correlations are 
among the animal enterprise tests. Correla- 
tions of . 735 between the swine and dairy cattle 
tests, . 623 between the poultry and dairy cattle 
tests, and . 576 between the swine and poultry 
tests, are statistically significant at the . 190 
level. No other correlation is statistically sig- 
nificant at such a high level. 

Among the low correlations in the technical 
agricultural test scores is noted the correlation 
ої . 084 between poultry and horticulture, .118 
between the dairy cattle and agronomy tests, 
and .169 between the swine and soils tests. 

There is a consistently positive correlation 
between all of the technical agricultural test 
Scores. This indicates thatagriculture instruc- 
tors who ranked high on one test tendedto rank 
high on other tests, and agriculture instructors 
who ranked low on one test tended to rank low 
on other tests. 


2. Manipulative Farm Skills 

_ There are quite a number of negative correl- 
ations between the technical agricultural test 
Scores and the manipulative farm skills survey 
Scores. Table V shows that only one of the cor- 
relations between technical agricultural test 
Scores and manipulative farm skills survey 
Scores is statistically significant. Thisone 
15 between the swine technical agricultural test 
and the swine manipulative farm skills. An ex- 
ample of a negative correlation between a tech- 
nical agricultural test score and a manipulative 
farm skills score is the correlation of -.125 be- 
tween the dairy and beef cattle manipulative 
Skill and the agronomy test score. An example 
оға positive correlation between a technical 
agricultural test score and a manipulative farm 
skills score is the correlation of . 057 between 
the poultry manipulative skill score and the 
agronomy test score. The consistently low cor- 
relations between the manipulative farm skill 
Scores and the technical agricultural test score 
indicate that there is very little relationship be- 
tween a vocational agriculture teacher's knowl- 
edge of factual information in agriculture and 
his own judgment regarding his ability to per- 
form agricultural manipulative skills. 

Intercorrelations among the manipulative 
farm skill scores give consistently positive 
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correlations. Practically all of these manipula- 
tive farm skill score inter-correlations are sta- 
tistically significant. Allintercorrelations of 
the animal enterprise manipulative farm skill 
Scores are statistically significant at the .1% 
level. Most intercorrelations of the mechanical 
and farmstead type of manipulative farm skill 
Scores are statistically significant at the .1% 
level. 

The only correlations among the manipulative 
farm skill scores that are not statistically sig- 
nificant are between gardening and poultry, con- 
crete and gardening, erosion control and garden- 
ing, erosion control and potatoes, home beauti- 
fication and potatoes, home beautification and 
concrete, home beautification and electrification, 
and home beautification and swine. 

The consistently positive correlations among 
the manipulative farm skill scores indicate that 
agriculture teachers who ranked themselves high 
in performing one manipulative skill tended to 
rank themselves high in performing other man- 
ipulative skills. Also, agriculture teachers who 
ranked themselves low in performing one manip- 
ulative skill tended to rank themselves low in 
performing other manipulative skills. 


3. Professional Educational Test 

As shown in Table V, the professional educa- 
tion test scores correlate positively with all of 
the technical agriculture test scores. The сог- 
relation between scores made оп Ше profession- 
al education test and the farm management test 
is statistically significant at ће . 1% level. 
There are statistically significant correlations 
at the . 1% level between the professional educa- 
tion and the dairy cattle test scores; between the 
professional educationand the poultry test scores; 
and between professional education andthe swine 
test scores. The correlation between pr ofes- 
sional education and the horticulture test score 
is statistically significant at the 5% level, while 
the correlations between professional education 
and the soils test score and between profession- 
al education and the agronomy test score are not 
statistically significant. 

АП correlations between professional educa- 
tion test scores and manipulative farm skill 
Scores are negative except one, and only one 15 
statistically significant. This gives the indica- 
tion that an agriculture teacher who ranked high 
on the professional education test tended to rank 
high on the technical agriculture test. Also, an 
agriculture teacher who ranked low on the pro- 
fessional education test tended to rank low on 
the technical agriculture test. It indicates that 
there is very little relationship between a voca- 
tional agriculture teacher’s knowledge of рго- 
fessional education information and his own 
judgment regarding his ability to perform man- 
ipulative farm skills. 
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TABLE V | 
THE INTERCORRELATIONS ОҒ AGE, YEARS OF TEACHING EXPERIENCE, TECHNICAL AGRICUL- | 
TURE TEST SCORES, MANIPULATIVE FARM SKILL SCORES, PROFESSIONAL EDUCATION | 
TEST SCORES, AND COMBINATIONS OF COMPOSITES OF COMPETENCY SCORES 
-< 
Tests in Technical Agriculture Manipulative Farm sal 
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Composite 


Professional Education 
Test 


Technical Agriculture and 
Professional Education 
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Manipulative Skills 
Technical Agriculture and 
Manipulative Skills 
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The correlations of the composite combina- 
tions of scores, shown in Table V, are without 
statistical meaning, and therefore the statisti- 
cal significance of them was not computed. 
These composite scores are often correlated 
with themselves which automatically raises the 
level of correlation. Wherethereare instances 
of a composite that has a high possible score 
being correlated with itself and a composite that 
has a low possible score, the resulting correla- 
tion is disproportionately high. An example of 
this can be seen between the composite scores of 
the professional education test and the manipu- 
lative farm skill survey being correlated with 
the manipulative farm skills composite. The 
correlation that results is . 994. However, the 
manipulative farm skills score that is being 
correlated with itself has a possible high of 
1065, while the professional education test has 
a possible high score of only 105. The scores 
actually made on these instruments (manipula- 
tive farm skills survey and professional educa- 
tion test) makes this improper balance even 
worse. For example, the mean score made on 
the manipulative farm skills Survey was 660 
which is 62 percent of the highest possible 
score, while the mean score of right ans wers 
made on the professional educational test was 


42 which is 40 percent of the highest possible 
score. 


Correlations of Competency Scores and 
Success Rating Scores 
——— n Scores 

1. Individual Ratings 

The correlation 

and individual rati 


Table VI. Inspec 
there are more stati 


and competency s 
any other individual rating scores and compe- 
tency scores. There isa Statistically signifi- 
cant correlation at the 5% level between the farm- 
er rating score and the poultry manipulative 
farm skills score. There are Statistically sig- 
nificant correlations at the 1% level between the 
farmer rating score and the farm managem ent 
test, between the farmer rating score and the 
poultry test, and between the farmer rating 
score and the composite of technical agriculture 
test scores. 

АП correlations between pupil rating scores 
and competency scores are statistically signifi- 
cant at the 5% level. These correlations exist 
between the pupil rating scores and scores made 
on the following tests: farm management, hort- 
iculture, soils, and the composite of technical 

i re test scores. 

о is а 5% level of statistical significance 
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between the principal rating scoresandthe farm 
management test scores, between the principal 
rating Scores and the poultry test scores, 
and between the principal rating scores and 
the composite of technical agriculture test 
Scores. 

There is а 5% level of statistical significance 
between the supervisory rating score and the 
farm management test score. The supervisory 
rating score has no other statistically signifi- 
cant correlation. However, it correlates high- 
er with the composite of the manipulative farm 
skills score than does any other individual rat- 
ing score. The farmer rating score correlates 
higher with the composite scores of the tech- 
nical agriculture test and the professional educa- 
tion test than does any other individual rating 
score. 

The composite of the individual rating 
Scores have a statistically significant correla- 
tion with a greater number of the competency 
scores than does any of the rating scores tak- 
en individually. Significantly, the compos- 
ite of the individual rating scores correlates at 
the 1% level of statistical significance with 
the composite of technical agriculture test 
Scores. It does not have a statistically signifi- 
cant correlation with either the composite 
manipulative skills score or the professional ed- 
ucation test. 

The correlations between each of the individ- 
ual rating scores and each of the competency 
composite scores are consistently positive. 
Each individual rating score has a statistically 
Significant correlation with the farm manage- 
ment test score. 

The correlations between individual rating 
Scores and the technical agriculture test scores 
are generally higher than they are between the 
individual rating scores and either the manipula- 
tive farm skills score or the professional educa- 
tion test score, Тһе correlations between the 
Scores and the professional ed- 
е5 are generally higher than 
the individual rating scores 
ive farm skill scores. Judg- 
St, and skills used inthis study, 
ndicate that there is a closer 


skills. Theres 
between his suc 
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2. Combinations of Ratings 

The correlations between competency scores 
and combinations of rating scores are present- 
ed in Table VI. This table reveals that the great 
majority of statistically significant correlations 
are found between the combinations of rating 
Scores and the technical agriculture test scores. 
Combinations of rating scores have statistically 
significant correlations with only three of the 
manipulative farm skills enterprise scores. 
Three of the combinations of rating scores have 
statistically significant correlations with the 
professional education test score. 

Five of the combinations of rating scores 
have statistically significant correlations with 
six of the competency score columns. These 
combinations of rating scores are: pupil-farm- 
ег, pupil-farmer-supervisory, principal-farm- 
er-supervisory, principal-farmer, andthe com- 
posite of combination rating scores. 

Four of the combinations of rating scores 
have Statistically significant correlations with 
five of the competency scores. These combina- 
tions of rating scores are: pupil-principal, pu- 
pil-supervisory, pupil-principal-farmer, and 
pupil-principal-supervisory rating scores. Prin- 
Cipal-supervisory and farmer-supervisory rat- 
Ing scores have statistically significant correla- 
tions with four of the competency scores. 

The composite of combinations of rating 
Scores correlates at the 1% level of statistical 
significance with the composite of technical ag- 
riculture test scores, and it correlates at the 
5% level of statistical significance with the pro- 
fessional education test scores. The correla- 
tion between the composite of combinations of 
rating scores and the composite score of ma- 
nipulative farm skills is positive but not statis- 
tically significant. 


The Prediction of Success 


А Table VII presents correlations used in re- 
jecting or accepting the first three null hypoth- 
евев postulated in this study. The correlations 
between the composite of technical agriculture 
test scores and the composite of individual rat- 
ing Scores, and between the composite of tech- 
nical agriculture test scores and the composite 
of combinations of rating scores are statistical- 
ly significant at the 1% level. This means that 
there isa statistically significant relationship 
between the technical agriculture test scores 
and the success of vocational agriculture teach- 
ers, Success being measured by composite of 
rating Scores. On the basis of these correl- 
ations being statistically significant from zero, 
the first null hypothesis postulated in this study 
was rejected. 

Having established that there is a statistical- 
ly significant relationship between a vocational 
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agriculture teacher's competency in technical 
agriculture and his success as a teacher of vo- 
cational agriculture, it was decidedto determine 
the predictive value of the coefficient of correla- 
tion. This was done in part by computing the 
standard error of estimate. (See Table VII.) 
The formula (12, 47) used in this computation 
was Sy = су/1 - r2, where oy = standard devi- 
ation of the predicted scores (composite of indi- 
vidual rating scores), and r - the coefficient of 
correlation between the two variables. Substi- 
tuting into the formula give Sy = 4.64/1-(:387)2. 
The standard error of estimate was found to be 
3.94 for the correlation between the composite 
of technical agriculture test scores and the com- 
posite of individual rating scores. Substituting 
into the above formula for the correlation be- 
tween the composite of technical agriculture test 
Scores and the combination of composites of rat- 
ing scores, we get Sy = 9. 57V 1 - (. 362)?, which 
equals 8.32. So, the error that might be expect- 
ed in predicting individual scores wherer- .362 
is more than twice as greatas the error that 
might be expected in predicting individual scores 
where г = .387. 

More specifically, the ratio of the res idual 
variance | or the value 1 - г (12, 47)| to the total 
variance is found to be . 85 for r = . 387 and . 87 
for r = .362. (See Table УП.) This means that 
only 15 percent of the total variance of scoresis 
accounted for by the first coefficient of corre- 
lation, and 13 percent of the total variance of 
scores is accounted for by the second coefficient 
of correlation. Thus, while both coefficients of 
correlation may have some predictive value for 
groups of vocational agriculture teachers, they 
have very limited value for predicting individual 
scores. 

As may be seen in Table VII, the correlations 
between the composite of manipulative farm 
skill scores and the composite of individual rat- 
ing scores, and between the composite of manip- 
ulative farm skill scores and the composite of 
combinations of rating scores are not statistical- 
ly significant. This means that there is no sta- 
tistically significant relationship between the 
manipulative farm skill scores and the succ e 55 
of vocational agriculture teachers, success be- 
ing measured by composites of rating scores. 
On the basis of these correlations being statis- 
tically insignificant from zero, the second null 
hypothesis postulated in this study was accepted. 

Using the same reasoning, methods, and pro 
cedures as those above, the standard error of 
estimate and the ratio of residual variance to 
the total variance were calculated for r = .131 
and r = .146. Results of these calculations ap- 
pear in Table VII. Neither correlation has any 
value for predicting group scores nor for pre- 
dicting individual scores. 

Again referring to Table VII, it may be seen 
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Manipulative Farm Skill Scores 
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that іле correlation between Ше professional ed- 
ucation test and the composite of individual rat- 
ing scores is not statistically significant. In 
order to be statistically significant at the 5% 
level, this correlation would have to beat least 
.258. The correlation of . 264 between the pro- 
fessional education test and the combination of 
composites of rating scores, however, is sta - 
tistically significant at the 5% level. This indi- 
cates that there is no statistically significant 
relationship between the professional education 
test score and the success of vocational agricul- 
ture teachers when success is measured bya 
composite of individual ratings. It also indi- 
cates, however, that there is a statistically sig- 
nificant relationship between the professional 
education test score and the success of voca- 
tional agriculture teachers when su ccess is 
measured bya composite of combinations of rat- 
ШЕ Scores. On the basis of this finding, the 
third null hypothesis postulated in this study is 
neither accepted nor rejected. It is left open 
for question and further study. 

The high percentage of residual variance 
found for both correlations is interpreted to 
wean that neither correlation has much value 
In predicting individual scores. 

It was decided that in order to check the 
а null hypothesis postulated in Section I, 

WO regression equations would be calculated. 
In the first regression equation the technicalag- 
riculture test composite score, the manipula- 
tive farm skills Survey score, and the profes- 
Sional education test score were used to predict 
the composite of individual rating scores. In the 
Second the same competency scores listedabove 
Were used to predict the composite combinations 
of rating scores. 

For solving the first equation mentioned 
above, the following symbols were assigned to 
the Variables: X,, composite of individual rat- 
Ings; X2, composite of technical agriculture 
test Scores; Хз, composite of manipulative 
farm skills Survey scores; and X,, profession- 
al education test scores. Then their intercor- 
relations were calculated and placed ina cor- 
relation matrix. (See Table ҮШ.) This matrix 
Was then solved, using Aitkin Modified Method 
of Pivotal Condensation (44, 12). Using the mul- 
tiple correlation formula (12), В, 234 = V Ber z+ 
Въга + B,r,, the beta coefficients were found 
to be В,. 24 = У(. 361)(. 387) + (.173) (. 131) + 

.091)(.236). тһе regression equation for all 
2s variables yields a multiple correlation of 


By using the formula t = ГУЇ and the 
Y1-R? 


t table in Statistical Methods in Research by 

Johnson (24), the multiple correlation of .429 was 
found to be statistically significant at the 1% lev- 
9l. This means that there is a statistically sig- 
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nificant relationship between the combination of 
competencies and success of vocational agricul- 
ture teachers, success being measured byacom- 
posite of individual rating scores. On the basis 
of this correlation being statistically significant 
from zero, the fourth nuli hypothesis postulated 
in this study was rejected, pending the findings 
of the second regression equation yet to be cal- 
culated. 

After concluding that the competencies have 
some relationship to success as measuredby the 
composite of individual rating scores, the next 
step was to determine the predictive value of the 
prediction equation. The formula Sy-cyY1-R? 
was used to calculate the standard error of esti- 
mate. Substituting into the formula gives 
Sy = 4. eAY1 - (-439)*, which equals 4.19. An 
example of the use of this standard error of esti- 
mate score is given by taking one actual predict- 
ed score of 52. 42. Using this actual predicted 
score of 52.42, one can predict that 95.45 times 
out of 100 the true score would be expected to 
fall between 44.04 and 60. 80. 

The ratio of the residual variance to the total 
variance for this prediction equation is .82. This 
means that only 18 percent of the total variance 
of scores is accounted for by this particular re- 
gression equation. So, while the regression 
equation may have some predictive value for 
groups of vocational agriculture teachers, ithas 
limited value for predicting individual scores. 

In order to check the reliability of the compos- 
ite of the technical agriculture test score, com - 
posite of manipulative farm skill survey score, 
and the professional education test score to pre- 
dict vocational agriculture teacher's success 45 
measured by the composite of combinations. of 
rating scores, a second regression equation 
was calculated. The following symbols were as- 
signed to the variables that were used in this 
equation: X,, composite of combinations of rat- 
ing scores; Хг, composite of technical agricul- 
ture test scores; X,, composite of manipulative 
farm skills survey scores; and Ха, professional 
education test scores. The matrix formedby the 
intercorrelation of these variables is presented 
in Table IX. 

Using the same methods and procedure 45 
those used in the first equation, it was found that 
the four variables used in this regression equa- 
tion yields a multiple correlation of .423. This 
correlation is statistically significant at the 1% 
level. Therefore, there is а statistically signif- 
icant relationship between the combination of 
competencies used in the regression equation, 
and the success of vocational agriculture teach- 
ers, success being measured by a composite of 
combinations of rating scores. Since this сог- 
relation is statistically significant from zero; 
it supports the finding of the first regresion 
equation and the fourth null hypothesis pos tu- 
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lated in this study was rejected. 

The standard error of estimate for the sec- 
ond regression equation is 8. 67. The ratio of 
the residual variance to the total varianceis .82, 
which is the same ratio as that found for the 
first equation. The conclusion is drawn that 
while this regression equation may have some 
predictive value for groups of vocational agri- 
culture teachers, it might be consideredas hav- 
ing limited value for predicting individual scores. 

In the first analysis of the data, the correla- 
tions of various enterprises under the technical 
agriculture tests and of various enterprises un- 
der the manipulative farm skills Survey seemed 
to be sufficiently high to warrant further study 
in search of more reliable regression equa- 
tions for predictive purposes. It was then de- 
cided to calculate four additional regression 

equations using the same methods and proced- 
ures as previously reported. These additional 
regression equations will make the third, fourth 
fifth, and sixth regression equations usedin this. 
study. 
The third regression equation involved the 
use of variables X,, the farm management test 
Score; Хз, the dairy and beef cattle manipula - 
tive farm skills score; and X;, the profession- 
al education test score to predict X,, the com- 


The matrix 
ese vari- 


level. The stan 


ariance to the to- 


This means that26pe 
of the total variance of scores is accounted for. 


by this particular regression equation. So 
while this regression equation has more value 
in predicting individual scores than either of the 
above equations, it still does not account Гог 
enough of the total variance to be of great value 
for that purpose. 

The fourth regression equation involved the 
use of variables Х,, the farm management test 
score; Хз, the dairy and beef cattle manipula- 
tive farm skills score; and X4, the professional 
education test score to predict X,, the compos- 
ite of combinations of rating scores. The ma- 
trix formed by the intercorrelation of these var- 
iables is presented in Table XI. The multiple 
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correlation of this regression equation is .492. 
This multiple correlation is statistically signifi- 
cant at the . 1% level. The standard error of es- 
timate for this equation is 8. 34, and the ratio 
of the residual variance to the total variance is 
-16. As was true with the previous regression 
equations, this one has no great value for pre- 
dicting individual scores. 

The fifth regression equation involved the 

Scores made oa two of the technical agriculture 
test enterprises, two of the manipulative farm 
Skill survey enterprises, the professional educa- 
tional test, and the composite of individual ra t- 
ШЕ scores. The variables and the symbols а5- 
Signed to them are: X,, the farm management 
test score; X,, the poultry test Score; X,, the 
dairy and beef cattle manipulative farm skills 
Score; X;, the poultry manipulative farm skills 
Score; Xs, the professional education test score; 
and X,, the composite of individual rating 
Scores. Variables X; through Х меге em- 
ployed to predict X,. The matrix formed by the 
intercorrelation of these variables is presented 
in Table XII. The multiple correlation for this 
regression equation is . 486, making it statisti- 
cally significant at the . 1% level. The standard 
error of estimate is 4.06 and the ratio of the res- 
idual variance to the total variance is .76. This 
is the same ratio as was found in the preceding 
equation, so the same conclusion can be drawn 
from it. It should be noted that by adding the two 
factors to the variables used in regression equa- 
tion number three the multiple correlation is loW- 
ered and not raised. 
The sixth and last regression equation calcu- 
lated involved the use of variables Х,, the farm 
management test Score; Хз, the poultry tes t 
Score; X4, the dairy and beef cattle manipula- 
tive farm skills score; Хе, the meadow and pas- 
ture manipulative farm skills score; and Хе, Ше 
professional education test score to predict Xi; 
the composite of combinations of rating scores: 
2. matrix formed by the intercorrelations of 
these Yariables is presented in Table ХШ. This 
"ores equation has a multiple correlation 

- 468, which is Statistically significant at the 


-1% level. The stand i үа 
8.46 and the ratio етта 


ісігі variance is , 78 i 
:18. This means that only 22 
percent of the total variance of scores is account- 
On equation and therefore: 
n predicting individual 
of note that by adding the 
есе to Ше variables used in r gression 
n number four the multiple correlation 15 
ie ХТУ Presents the multiple correlations: 
2. Significance, standard error 
w ч ; апа residua] variances for the six 
regression equations calculated in this study. In 
comparing Table XIV with Table үш it is noted 
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TABLE X 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER THREE 


Xi X2 X3 X4 

хі 1.000 . 425 2256 „236 

хә ‚425 1.000 š 011 . 466 

X3 .256 = 201 1.000 - .119 

X4 . 236 .466 - 2179 1.000 
TABLE XI 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER F OUR 


Xi X9 X3 Ха 

Xi 1.000 .397 .250 .264 

X2 . 397 1. 000 = 011 .466 

X3 .250 - .011 1.000 - 179 

X4 . 264 .466 = „ала 1.000 
TABLE XII 


CORRELATION MATRIX FOR SOLVING REGRESSION EQUATION NUMBER FIVE 


Xi хо X3 X4 X5 Хв 

Xj 1.000 .425 .331 .256 .241 .236 
X2 .425 1.000 ‚264 = 011 1119 . 466 
X3 . 331 . 264 1.000 .010 .052 . 344 
X4 ‚256 - .011 010 1. 000 ‚633 = 179 
X5 .241 .119 .052 .633 1.000 - .062 
1. 000 


Xg .236 .466 . 344 - .179 - .062 
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TABLE XIII 
CORRELATION MATRIX FOR SOLVING REGRESSION EQUA TION NUMBER SIX 
X х2 хз X4 X5 Хв 

хі 1.000 . 397 . 343 250 . 234 . 264 
хә . 397 1. 000 264 - .011 . 200 . 466 
X3 . 343 . 264 1.000 010 - .094 . 344 
ха ‚250 = „011 . 010 1. 000 .427 - 119 
X5 .234 - 200 - .094 .427 1.000 - .087 
X6 . 264 -466 i - .179 - .087 
ПО НИ 


Regression Multiple Levels of 


Residual 


Significance of Estimates Variance 
1 .429 1% 4.19 


Equation* 


2 
3 
4 
5 


6 


Correlations 


.423 
. 508 


1% 
-1% 
-1% 
-1% 
-1% 


Standard Error 


8. 67 


.82 
.82 
- 74 
. 76 
. 76 


. 18 


*Regression equations are listed in the same order that they are Presented in this Section. 
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that all multiple correlations are higher than 
the Simple correlations. Also, the residual 
Variances of the regression equations are low- 
er than the residual variances of the simple сог- 
relations, indicating that the multiple correla- 
tions are better predictors of vocationalagricul- 
ture teacher success than are the sample cor- 
relations. 

| АП multiple correlations аге statistically 
significant, indicating that the relationships 
found cannot be attributed to chance alone. Re- 
gression equation number 3 appears to be the 
best predictor of vocational agriculture teacher 
Success investigated in this study. In the third 
regression equation, the farm managementtest 
незнаю Ше dairy and beef са Ше manipulative 
Hon t Skills score, and the professiona] e du ca- 
на est score were employed to predict the suc- 
і $ of а vocational agriculture teacher, Ше cri- 
егіоп of success being Ше composite of individ- 
ual rating scores. 


SECTION IV 
SUMMARY AND CONCLUSIONS 
Statement of the Problem 


"RI PURPOSE of this investigation was to 
ii TS relationship between the success at- 
s by vocational agriculture teachers and 

їп competencies that these vocational agri- 
Culture teachers possess. 


"я The subjects of this investigation were a ran- 
А m sample of sixty vocational agriculture 
E ac hers who teach in one teacher vocational 
оова departments of public high schools 
er ated in approximately the southern two-thirds 
the state of Wisconsin. 

cio eee of teacher success was deter- 
воле T ratings given to each vocational agri- 
санага eacher by: (1) state supervisors of vo- 
(3) high agriculture, (2) high school principals, 

he School pupils taught by the teacher, and 
корда іп the local School community. A 
posits ite score of individual raters and a com- 
used; Score of combinations of raters were 

n analyzing the data. 

quie competencies of vocational agriculture 
we S that were measured in this investiga- 
iani a in Ше. areas of technical agriculture, 
italien ative farm skills, and professional ed- 
was и Technical agriculture competency 
infürm уа by administering tests of tactual 
fields ation in seven technical agricultural 
omy n These tests were in the areas of agron- 

» dairy cattle, farm management, horticul- 


tea 
tio 
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culture, poultry, soils, and swine. 

Competency in manipulative farm skills was 
measured by a self-rating survey of manipula- 
tive farm skills that was completed by each sub- 
ject. This survey of skills was limited to fif- 
teen farm enterprises or areas as follows: dairy 
and beef cattle, poultry, swine, corn, meadows 
and pastures, small grain, gardening, potatoes, 
fruit growing, concrete, electrification, farm 
machinery and power, erosion control, home 
beautification, and farm plumbing. 

The measure of professional education com- 
petency of vocational agriculture teachers was 
accomplished by administering the professional 
information section of the 1951 edition of the Na- 
tional Teacher Examination to each teacher par- 
ticipating in this investigation. 

Using the two composites of scores for the 
criteria and the raw scores from the measures 
of competence, Pearson product-moment corre- 
lations and regression equations were calculat- 
ed to determine the relationship between voc a- 
tional agriculture teacher success and certain 
competencies possessed by these teachers. 


Summary of Findings 


All tests in technical agriculture were de- 
signed and developed in a similar manner. They 
all dealt with basic and fundamental factual m a- 
terial in their respective areas. Because of 
these similarities, the various tests of technical 
agriculture were assumed to have approximate- 
ly equal difficulty and equal basic understanding 
requirements. 

Percentage scores made on the tests in tech- 
nical agriculture indicate that vocational agri- 
culture teachers in Wisconsin, from which this 
sample was chosen, have a better knowledge of 
basic facts in animal enterprises than they have 
in other farming enterprises investigated in this 
study. These teachers appear to have less knowl- 
edge of basic facts in soils and farm manage- 
ment than they have in other areas of farm en- 
deavor investigated in this study. Their knowl- 
edge of basic facts in agronomy and horticulture 
seems not as great as their knowledge of basic 
facts in animal enterprises. However, their 
knowledge of basic facts in agronomy and horti- 
culture seems greater than their knowledge of 
basic facts in soils and farm management. қ 

The mean score made by Ше vocational agri- 
culture teachers on the professional education 
test was about thirteen points lower than the 
mean score made by persons who expressed а 
preference for teaching vocational subjects who 
took the nation-wide administration of the same 
test in 1951. This comparison must be made 
with caution since the number of vocational 
teachers used in this study is small compared 

with the number of persons expressing уоса- 
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tional teaching preferences who took the nation- 
al administration of the test in 1951. Also, per- 
sons taking the national administration of the 
test in 1951 may have made special study and 
reviews in preparation for taking the test be- 
cause of its use in teacher evaluation and pro- 
motion in some situations. No such special 
preparation was made by teachers participating 
in this study. 

There was no particular relationship among 
the mean, high, and low percentage scores 
made on the various enterprises of the manipu- 
lative farm skills survey. This indicates a 
rather wide diversity of individual competencies 
in performing agricultural skills. 

There were consistently low correlations be- 
tween the manipulative farm skills Scores and 
the technical agricultural test scores. These 
consistently low correlations indicate thatthere 
is very little relationship between a vocational 
agriculture teacher's knowledge of factual infor- 
mation in agriculture and his own judgment of 
his ability to perform manipulative farm Skills. 

All correlations between the professional ed- 
ucation test scores and scores made on various 
enterprises of the technical agricultur e test 
were positive, anda majority of th 
tistically significant. 

significant correlation 
education test score and 
ture test composite score. 
indicate that there is a Signi 


All correlations betwee: i 
п professional е - 
Поп test scores and mani i TM 


farm skills. 
In order to facilitate the achievement of the 
purpose of this study, four null hypotheses 
were formulated. These hypotheses served as 
a guide in making basic judgments that were nec- 


essary in this study. The four null hypotheses 
tested in this study were: 


1. There is no statistically Significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher’ 5 
knowledge of technical agricultural informa- 
tion and his success as a teacher. 


2. There is no statistically significant relation- 
ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher 5 
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proficiency in performing agricultural man- 
ipulative skills and his Success asa teacher. 


3. There is no statistically significant relation- 
Ship, as shown by coefficients of correlation, 
between a vocational agriculture teacher's 
knowledge of professional educational infor- 
mation and his success as a teacher. 


4. There is no Statistically significant relation- 


Ship, as shown by regression equations, be- 
tween a vocational agriculture teacher's 
knowl 


š edge of technical agricultural informa- 
tion, proficiency in performing agricultural 
manipulative skills, and knowledge of pro- 
fessional educational information and his 

Success as a teacher. 


The first null h 
was rejected. 
Statistically si 
composite of t 


ypothesis postulated above 

It was rejected on the basis of 
gnificant correlations between the 
echnical agriculture test scores 
site of individual rating scores, 
he composite of technical agricul- 


ture test scores and the composite of combina- 
tions of rating scores. 


The second 


make them entir i } 
individual б T satisfactory for predicting 
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Score, and Ше professional education test score 
to predict the composite of individual rating 
Scores. Тһе technical agriculture tests were 
better predictors of vocational agriculture 
teacher Success than were the manip ulative 
epa Skills, which had very little relationship 
О Success, or the professional education test, 
Whose exact relationship to vocational agricul- 
pm teacher Success was not determined. The 
та predictor of vocational agriculture 
Cher success was the farm management test. 


Conclusions 


" Tho relatively low percentage scores made 
obere arm management and soils technical ag- 
and ure tests, the professional education test, 
0 several of the manipulative farm skill enter- 
sin leads one to question the adequacy of the 
| riculum of training of vocational agriculture 
еасһегв in these areas. 
T. vocational agriculture teacher needsa com- 
res ensive knowledge of farm management and 
с if he is to give maximum service to farm- 
үкү: farm management test correlates 
other with Success rating composites thanany 
tine пере competency measure. This indi- 
& oe fe there isa closer relationship between 
iuba ational agriculture teacher's success, as 
asured by composites of ratings, and his 
ана о! basic information in farm manage- 
ie than there is between his success, as 
of б by the same criteria, and knowledge 
Pun Sic information in any other technical agri- 
ural enterprise investigated in this study. 
бее correlations between both soils test and 
о fessional education test with success as 
is ‘sured by composite of ratings is statistical- 
Significant. 
ibas. bows in this investigation tend to substan- 
tion bp by Rhoad (study referred to inSec- 
Ания » Concerning Ше ability of vocational ag- 
тт s teachers to perform manipulative 
Налат ills. It cannot be assumed that voca- 
желілі DAMEN teachers adequately learn to 
lagare m manipulative farm skills on the hom e 
p A All teachers participating inthis study 
пої jug rm reared except one, and yet, they do 
in menos themselves as being very proficient 
of this fee manipulative farm skills. In view 
їн. ing, it would appear wise for training 
of ты, ю devote more time to the training 
tive а agriculture teachers and prospec- 
Skills ers to perform manipulative farm 
more efficiently. 


Im 


Plications for Further Study 


thea Доза of findings іп this investigation, 
Hong: Or wishes to make five recomm enda - 
Ог further study along the line of predict- 
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ing vocational agriculture teacher success. 

The first recommendation is that the farm 
management test, the poultry test, the soils test, 
and the swine test that were used in this investi- 
gation be given further study with a view toward 
making them, if possible, better individual and 
collective predictors of vocational agriculture 
teacher success. These tests of technical agri- 
culture showed statistically significant relation- 
Ships with vocational agriculture teacher suc- 
cess as measured by composites of raters. 
Through an item analysis one could determine 
which questions in these tests best differentiate 
the most successful teachers from the less suc- 
севвіш teachers. In this manner one might de- 
velop an instrument that would better predict vo- 
cational agriculture teacher success. 

The second recommendation is that the pro- 
fessional educational test used in this investiga- 
tion be given further study with a view toward 
making it a valuable predictor of vocational agri- 
culture teacher success. The value of the pro- 
fessional education test as a predictor of voca- 
tional agriculture teacher success was inconclu- 
sive in this investigation. As previously stated, 
the subjects used in this investigation made rel- 
atively low scores on the professional education 
test. It might be that vocational agriculture 
teachers are so laden with keeping conversant 
with technical information that they are for c ed 
to give professional information m inimum at- 
tention. Then too they may depend more on prac- 
tical, seemingly logical solutions than upon 
knowing established principles. An item analy- 
sis of the professional education test should indi- 
cate the type of professional questions that agri- 
culture teachers answer correctly and whichare 
the most discriminating questions. Such knowl- 
edge might aid in the development of an instru- 
ment in professional education that would be par- 
ticularly suited for predicting vocational agri- 
culture teacher success. 

The third recommendation is that additional 
objective data such as age, teaching experience, 
college grade point average, credits in technical 
agriculture received in college, credits in pro- 
fessional education courses received in college, 
credits in general education courses received in 
college, and practice teaching cre dits be em- 
ployed in a study such as this to predict voca- 
tional agriculture teacher success. Ifc e rtain 
objective data suggested here were used in con- 
junction with the most predictive variables of vo- 
cational agriculture teacher success usedin this 
study, improved prediction of vocational agri- 
culture teacher success might be possible. | 

The fourth recommendation is that cer tain 
subjective data in the areas of human r poe ай 
ships and personality be employed in a statis а 
cal way to determine their importance ав рге 
dictors of vocational agriculture teacher suc- 
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cess. The somewhat unique responsibilities 
and duties that a vocational agriculture teach- 
er has in a school and in his community might 
make his personal qualities very important to 
his success as a teacher. The use of Such sub- 
jective data in conjunction with certain objec- 
tive data might prove to be of great value for 
predicting vocational agriculture teacher suc- 
cess. 

Finally, the author recommends fur ther 
study of subjective ratings, andthe possible use 
of residual pupil gains as Success criteria in 
Studies of vocational agriculture teacher s uc- 
cess. Тһе criterion by which teaching success 
is evaluated is of great importance. An objec- 
tive criterion such as residual pupil gains might 
add much to studies of this kind. Thefact that 


than ratings used singly. However, more study 
is needed in defining 


evaluated and in objectifyi 
as much as possible. 
use of these гесотте і 
Studies of the predicti 
ture teacher Success, 
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THE ROLE OF EVALUATION IN TH 
E IM- 
PROVEMENT OF INSTRUCTION IN INSTI- 
TUTIONS OF HIGHER LEARNING 


JAMES E. 


GREENE, Sr. 


University of Georgia 


m APPROACHING the present task of dis- 
nent the role of evaluation in the improve- 
RARE instruction, an attempt will be made to 
рег дає brief, tentative, and perhaps somewhat 

Sonalized answers to the following questions: 
1. What is the essential rationaleofa philosophy 
of evaluation of instruction? 


- What evidences can be cited to indicate that 
emphasis upon improved evaluations of in- 
Struction tend to improve the general quality 
of instruction? 


+ How can an institution of higher learning im- 
Fin its program of evaluation of ins truc- 
lon? 


TE Our present purposes, the term: evalua- 
matin а be used as referring to (1) a process: 
valu ) a product. Considered as a process, 2 
whi ation refers to the procedures by means о 

со ich value judgments are made concern ing à 
M eren ог procedure having implications for 
Р instruction. Considered as a product, 
tic uation refers to the nature and characteris- 

S of the value judgments themselves. 


1 


Де Rationale of a Philosophy of the Evaluation 


9! Instruction 


n the rationale of 
f instruction, 
the development 
logical analysis 
іуей in ef- 
urposes 

ffec- 


ale phasis is to be placed 0 
e fir ion in the improvement 0 

of pur ТЕ logical step involved in 

бї ihe pas would consist of a 104 

fective кыз, constituent elements invo 

it is ac For our present p 

ive in that instruction is likely to be © 

Proportion as: 

1, 

Pisis Objective of instruction is clearly m 

od and fully accepted by the learner andis 
iquely appropriate to his abilities and needs 


omprising 
teacher and 
terials of 


- Е 
"y of the learning situations C 
lea гасбіопаї program (i. e€., 
ner activities, methods and ma 


rticles (in 
hed elsewhe 


the AAAS in 


Thi, 
w 5 art 


illiam 


instruction, climate of learning, etc.,)isnice- 
ly adapted to the efficient attainment of one or 
more of the objectives sought. 


Teacher and learner each secure, analyze апа 
interpret evidences concerning the total effic- 
iency of the instructional process. 


The overall task of evaluation in relation to 
the improvement of instruction would appear thus 
to consist of finding sound and defensible ап- 
swers to such questions as the following: 


1. To what extent has each learner made or 
failed to make satisfactory progress toward 
the attainment of each of the objectives of in- 
struction originally formulated and accepted 


by both teacher and learner? 


To what extent were the original objectives of 
instruction appropriate or inappropr iate to 
each learner? 


What revisions, if any, of the objectives of in- 
struction would appear to be desirable? 


To what extent were the instructional proced- 
ures (i.e., materials, methods, etc.,) appro- 
priate to the attainment of the specific objec- 
tives sought? 


What revisions, if any, of the instructional 
procedures appear to be desirable? 


If evaluation is to serve the purposes thus far 
stated or implied, it is requisite that evaluations 
conform to certain basic principles and that cer- 
tain basic procedures in evaluation are rigorous- 


1у observed. 


What basic principles are involved in the evalua- 


tion of instruction? 


Conformity to the following principles is held 
to be basic to the development of a sound pro- 


gram of evaluation: 
Evaluations of instruction must have a defin- 


article each by Drs. Ralph Berdie and 
ted before the symposium jointly 


Atlanta, Georgia, December 27, 1955. 


cluding an 
re) were presen 
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ite frame of reference. That is, evaluations 
are to be made in terms of the specific values, 
goals or objectives of teacher and learner if 
such evaluations are to be meaningful and help- 
ful. Evaluative procedures which fail to take 
into account the self-determined goals of the in- 
dividual being evaluated are not only of limit- 
ed or doubtful worth; they may actually be per- 
nicious in their distorting or coercive effects. 
Evaluations should be continuous and c umu- 
lative. Any evaluation as of a given moment 
is likely to be erroneous or incomplete in cer- 
tain particulars; and, in any case, evaluations 
ав of a given moment cannot show changes in 
status. Furthermore, since the goals of indi- 
viduals change as conditions change, it is nec- 
essary for sound evaluative procedures to take 
into account these changes in individual goals 
for the reason that the prognostic significance 
оға given evidence of excellence may vary 
from time to time in such a way as to make that 


evidence of greatly unequal value on different 
occasions. 


ures will emphasize fle 
growth in terms of diff, 


of a condition or a process) it is clear that sound 
evaluative procedures will involve the active 

participation of the persons primarily concerned 
in the evaluation. That is, effective evaluation 
will emphasize self-appraisal activities. How- 


1. Suggesting clarificati 


2. Suggesting possible te 
for securin, 
attainment; 


chniques andprocedures 
5 appropriate evidences of goal 


3. Suggesting cautions 
ing the obtained evi 
sought. 


to be observed in г elat- 
dences to the objectives 


What basic Procedures are involved in the 
evaluation of instruction? 


_ Evaluation of instruction involves the follow- 
ing fundamental processes: 


Securing А 
Product, огр 


а 
jective data, or both. 


: › interviews, 
Сев, observational 


е ЕН he type of 
the evaluation Will be s па (5а, Obviously, 


ly in proportion 
е evidence upon 
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. Relating the Obtained Evidences to the Objec- 
tives Sought— This step involves critical, reflec- 
tive thinking in answering the query, “То what 
extent do the available evidences indicate that 
the desired objectives have been or are being ef- 
fectively realized?’’ It is again obvious that the 
evaluations obtained will be dependent upon the 
Soundness of the analytic procedures employed 
Іш arriving at them. 


Empirical Justification of an Emphasis on Im- 
proved Evaluations of Instruction 


. The empirical data to be here cited will be 
limited to a single institution. As Базе оп their 
experiences as former members of the Education- 
al Advisory Staff of Air University, Maxwell Air 
Force Base, Alabama, in а series of previous 
рарегз* the writer and certain of his profession- 
al associates have attempted to demonstrate that 
Systematic emphasis on the improvement of eval- 
uative procedures not only resulted in improved 
evaluations per se but also contributed to im- 
Proved objectives of instruction and to improved 
instructional procedures. | 

One of these previous papers dealt with the 
Sub-hypothesis that the quality of instruction 
could be improved by means of (1) improving ob- 
Jective test items, (2) improving the measure- 
ment of intangibles, and (3) utilizing student par- 
ticipation in the evaluation of instruction. 

The evidence that emphasis upon the improve- 
ment of objective test items actually resulted in 
improved evaluations consisted of considerable 
data showing a measurable and statistically Sig- 
nificant improvement in such test items ав meas- 
ured by increased validity coefficients and by an 
improved functional content of test items оп Sur- 
cessive tests in the same area of instruction. It 
Was further found that improved validity coeífi- 
Cients and improved functional content of test 
items were accompanied by increased ‘‘face val- 
idity” of tests, increased student satisfaction 
With the “fairness” of tests and an inerea 5 ed 
critical concern by instructors and students rel- 
аНуе to the appropriateness of the instructional 
Objectives and the teaching procedures employed. 

Time limitations preclude the presentation 
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here of detailed evidence indicating that empha- 
sis on the evaluation of intangible outcomes and 
on the participation of learners in the evaluative 
process was accompanied by improved evalua- 
tions per se as well as improved objectives and 
improved instructional procedures. It may be 
summarily stated, however, thatthese evidences 
included such concrete data as changes in the of- 
ficial statements of the objectives of particular 
units of instruction, changes in the amounts of 
time devoted to particular units of instruction, 
and changes in the amount of time devoted to par- 
ticular instructional procedures (i.e., lecture, 
discussion, demonstration, etc.). Theevidence 
also included the systematically analyzed judg- 
ments of members of the Educational Advisory 
Staff, of the instructional staff, and of the stu- 


dents themselves. 


Institutional Improvement in the Evaluation of 


Three general suggestions are made relative 
to improved evaluations of instruction in individ- 
ual institutions of higher learning: 


1. Recruitment—In the employment of instruc- 
tional personnel special emphasis should be 
given to the competencies in evaluation of pro- 
spective employees. 


2. In-service training—Considerable evidence in- 
dicates that an in-service training program 
can bring about notable improvements in the 
evaluation competencies of instructors. 


3. Specialized evaluation services—Experience 
in the armed services, in many secondary 
schools and in a few institutions of higher 
learning appear to warrant the belief that pro- 
vision by the Central Administration of spec- 
ialized evaluation services, available on a 
voluntary basis to members of the instruction- 
alstaff, tends to bring about not only marked 
improvement in the evaluation of instruction 
per se but also facilitates improved instruc- 
tional objectives and improved procedures of 
instruction. 


James E. Greene, "Тһе Evaluation of In- 
James E. Greene and War- 
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THE ROLE OF EVALUATION IN THE IM- 
PROVEMENT 0F PLACEMENT AND 
FOLLOW-UP IN INSTITUTIONS 
OF HIGHER LEARNING 


PAULI. CLIFFORD 
Atlanta University 
Atlanta, Georgia 


th THE PURPOSE of this paper is to examine 
е role that evaluation can play in the imp r Ove- 
ment of the placement and follow-up aspects of 
S: services in institutions of higher learn- 


Conceptual Framework 


ev ш Order to adequately identify the role of 
t aluation in these areas, it is first necessa r y 
to provide a frame of reference or a set о terms 
into which the discussion can be cast. This con- 
Ceptual framework includes precise definitions 
серпш these terms and their interrelations 
which have been accepted by the writer. Evalua- 
lon, in the specific sense used in the present pa- 
А refers to the various technics and process- 
^ Which can be utilized to determine the degree 
to which definitely stated and clearly defined ob- 
Fg ns of the placement and follow-up services 
is being attained. Thus, evaluation incl uds 
lect means by which valid evidence may be E: - 
the ed and interpreted for the purpose of ju ging 
ar efficacy or value of present procedures tha | 
"S being employed to attain the specific ends 0} 

пе and follow-up. 
иа ОЧЕН placement and follow- me 
inse Considered as distinct services, m 
menr 16 in both theory and practice. Pla e- 
Which a be defined as а multi-phasic proc Š = 
сопс aids ап individual to make those decisio 
which wine an educational or vocational next S! ер 
pro Will increase the probability that he wi 
Senile, satisfactorily from one educational or 

е tional experience to another. Follow-up i$ 
Е A a phase of placement and all the oth- 
апа mao UM services involved in the guida © е 

Pl Structional programs of a given institution. 

its sei in its educational phase, has о, 
Student Objective the matching of an individua 
Perie and an array of particular educational ex- 
ly айаш іп such а way that the studént will like- 
bhase іп maximum benefit. In its vocational 
Vidua] e aim of placement is to assist the indi- 
of work. find his appropriate place in the world 
job, a y, Appropriate, as used here, means à 
Sonant НО, ог a profession which (1) is соп- 
with one’s interests and other emotionally 


up are ом е-. 


toned preferences, (2) on a level with the config- 
uration of one’s general and specific mental abil- 
ities, (3) makes use of one’s achievements and 
past acquisitions of skills, (4) makes no physical 
demands upon the individual that he cannot satis- 
fy, (5) is personally satisfying or rewarding to 
the individual to the degree that it continually 
contributes to higher levels of personality integ- 
rity and stability, and (6) makes a significant 
contribution to the improvement of the social or- 
der with which the individual is in interaction. It 
must always be borne in mind that placement is 
individually oriented. Its principal focus is al- 
ways the individual who is being placed. Ріасе- 
ment should not be confused with either recruit- 
ment or selection. Recruitment, in contrast to 
placement, is concerned primarily with meeting 
the needs of employers for workers or of educa- 
tional institutions for students, while selectionis 
the process, by which, from among many appli- 
cants, certain ones are picked for given and lim- 
ited educational or vocational experiences. It 
should be apparent that since the fociof the place- 
ment, selection, and recruitment services are 
different, the three terms should never be used 
synonymously or become confused in our think- 
ing. 
Follow-up is conceived of as the continuous 
process of determining, by any valid means, the 
degree to which an individual’s educational or vo- 
cational choices are rewarding or satisfying to 
him in terms of the six criteria of appropriate- 
ness identifiedabove. Follow-up services should 
not be thought of as applicable only to the gradu- 
ates of an institution of higher learning but should 
be conceptualized to include the appraisal of the 
degree of educational or vocational adjustment of 
those who have withdrawn before graduation. It 
should be axiomatic that both placement and fol- 
low-up services should be employed with former 
students as long as there is need on the part of 


the individual for these services. 


Basic Assumptions 
Basic Asses 


At this point, it is necessary to present the 
basic assumptions which the writer has accept- 
ed in the preparation of this paper. The first 
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assumption is that our institutions of higher 
learning are genuinely concerned with develop- 
ing to the fullest extent possible the potentiali- 
ties possessed by each student which they ad- 
mit. If this assumption is valid, it follows š 
then, that our educational enterprises have the 
moral responsibility of using the totalityoftheir 
resources not only to help theirformer students 
to take the next appropriate educationalor voca- 
tional step, but also to determine as validly as 
possible whether the step taken was the one 
most likely to eventuate in satisfaction to the in- 
dividual and benefit to Society. 

The second basic assumption is that the only 
means by which a given institution of higher 
learning can determine the degree to which 
its placement and follow-up Services are attain- 
ing their objectives is to carry on planned, va]. 
id, comprehensive, and continuous appraisals 
of these programs. 


The fourth basic 
which are derived + 


both poles of the individual— vocational Or edu- 
cational spectrum. 


Roles of Evaluation and Follow-Up 


In view, then, of the conceptual framework 
and the basic assumptions of this paper, it is 
possible to identify the roles of evaluation in 
placement and follow-up in institutions of high- 
er learning as at least four in number. 

The first of these is to provide basic infor - 
mation about the individual Student in terms of 
his general and specific mental abilities, his 
School achievement, his interests, his person- 

ality integration, his Socialization, his physcial 
status, and any other attributes which are rele- 


vant to success in further educational endeavors 
or in the world of work. In playing this role 
evaluation makes it possible for the psychologist 
ог the personnel Worker to synthesize à set of de- 
scriptions of the individual’s behavior in these 


І employees, Unless evalu- 
ation plays the Second role just identified, its 


first role Will be of little avail. Unless a per- 


Sample of their Student: 


1 8” furt 
Vocational endeavors, а 


up isa gigantic One 
We have been attempting, for Over half acen- 
tury, to improve our Methodologicay approaches 
to more valid апа comprehensiye descriptions of 
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the behavior and functioning of human beings. 
We have barely scratched the surface, however, 
in determining how we might use these data that 
We can collect in order to match men and oppor- 
tunities. This, to the writer, is the challenge 
of the future. 
.. The notion that evaluation can play а role in 
identifying the nature of vocational opportunities 
in America is a relatively novel one. It should 
be Possible for psychologists, personnel work- 
"usd job analysts and others to pool their compe- 
ТЕ in such а way as to produce а classifica- 
"à of Occupational opportunities in terms of (1) 
Bite primary personal attributes which workers 
fice possess if they are likely to be success- 
fama One or more of the various occupational 
amilies, (2) the degree of general and special 
eoi abilities which students must possess if 
hey are to learn to function properly within а 
&iven family of occupations, and (3) the kinds of 
educational achievements which are necessary 
Or the student to enter one or more of the vari- 
es occupational families. It should be pointed 
e here that, at best, we have only made very 
ae beginnings at estimating or guessing what 
tic many worker constellations of characteris- 
їй S, traits, or attributes required for success 
оК vastly complicated world of work are. И 
i: аге to improve upon these best guesses, we 
D begin the tremendous task of applying all 
atin, modern technics of measurement, evalu- 
ion and assessment to this problem which will 
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continuousiy become more difficult. 


Concluding Statement 


In conclusion, the writer would like to point 
out that one consequence of the wide acceptance 
of the four roles that evaluation can play in place- 
ment and follow-up, would be the saving of great 
sums of money by business. It has been estimat- 
ed that the misplacement of a single employee in 
a business enterprise can собі гот $50.00 to over 
$20, 000.00 depending upon thelevel at which the 
misplaced person is functioning. It is presently 
beyond our capabilities to translate into dollars 
andcents the loss which business enterprises suf- 
fer in the areas of general employee morale, su- 
pervisory and administrative difficulties, high 
employee turnover, and diminished customer 
goodwill because of poor placementpolicies. The 
price paid in human unhappiness and in vocation- 
al mal-adjustment is inestimable. 

Another consequence of the acceptance of the 
multi-dimensional roles of evaluation in placement 
and follow-up as identified in this paper could be 
the stimulation of more rigorous andprecise re- 
search within the general field of the behavioral 
sciences and the specific fields ofpsychology 
and education. Only as research suggests the 
answers as to how we can better understand man 
on the one hand, and the world in which he lives 
on the other, can we attempt to effect à more 
satisfying rapprochement between the two. 


= 


THE ROLE OF EVALUATION IN SPECIAL 
SCHOLARSHIP SELECTION PROGRAMS 


WESLEY W. WALTON 
Educational Testing Service 
Princeton, New Jersey 


өз TIME WAS when the award of a scholarship 
Ven a matter strictly between a youngster anda 
as ege. Things are по longer thatsimple. Schol- 
ие Selection is rapidly becoming a big busi- 
eM Third parties, fourth, and fifth now are 
test ved. High school counselors screen and 
са candidates. Principals and headmasters ex- 
diam е candidate rating scales and furnish secon- 
1 y School records. Testing bureaus in col- 
eges and elsewhere administer secure testing 
i UMS. Selection committees of college ad- 
с Ssions deans dive into seas of data to reach 
Onsidered judgments as to who should receive 


eindlarship awards and who should not. Finan- 
al analysts determine how much is needed 
an 


те the scholar's budget in the black; 
to Дина Sponsors furnish the funds necessary 
to c Ove sponsored scholars happily оп their way 
ee and through it. 
and a does one filter out of a gro Е 
ing 50 ably able scholarship aspirants num вр. 
high „000, the 600 who can make best use о 
іп he education? This was the problem faced 
Бе National Merit Scholarship Program in 
sured d Or, by what means may ме besthe as- 
notab] that the group of 16, 000, 25 eager m 
Sight: e as those mentioned above, but with г: 
award Оп General Motors National Scholars ip 
100 s T are rendered down most equit 4 
has je Olarship recipients? The latter problem 
tors ied faced for two years in the General 
oe ола! Scholarship Plan. — 
that us, for a moment, develop an hypo x. 
Нера НЕ people іп America come to 2 sop 
a €d understanding of the competitive system 
а oen age. Interest in competing for acl - 
talent, Opportunities is high. Further, that wx 
eir €d among them seem to adjust readily 
willing to version of such a system. They E 
Stadt, to take their chances. Finally, tha Eid 
ec ng up to a nationally competitive situa p " 
сот andidate's whole concern is directed toa 
- nmendable performance as а scholarship Can 


up'of eager 


i + 
oe He is so engrossed in the task that e в 
враца обвр that he may ‘‘estimate”’ the о 

St his winni 
inning. s which 


tay b us now add to the picture factor 
Y better be assumed than hypothesized. 


rships to ЕО 
deserve them. 
d inadequate, 


1. Е 
ы е are not enough schola 
и Ound to those who need and 
Substantial, though small an 


number of young people who need and deserve 

scholarship aid will come through a scholar- 

ship competition successfully. Their accom- 

plishments will long redound to the benefit of 

their benefactors, and they wili contribute 
their bits to society on a higher plane than 
might otherwise have been the case. 

3. Many who need and deserve scholarship aid 
will come through a scholarship competition 
unsuccessfully, and may perforce be keptfrom 


going to college as a result. 


These groups of considerations, as they ге- 
ate to special scholarship selection programs, 
several ‘‘insomnia breed- 
ers" experienced by people working in this as- 
pect of evaluation. How may a scholarship selec- 
tion committee be sure that it is being fair and 
just in removing 2 given candidate from further 
consideration? How does one distinguish minute 
but critical differences among the very top of a 
given ability grouping? What elements go into 
the selection of the very best scholarship risks? 

At least partial answers to these questions 
may be found in the 1955 selection proceedings 
of the General Motors National Scholarship Plan. 
Scholarship selections were made by a nationally 
representative committee of college educators 
d secondary school men. The high caliber of 
ership may be illustrated by citing the 
of President and Admissions Dean 
he following: Vanderbilt, Notre 
Mawr, MIT, Dartmouth, Stanford, 
University of Michigan. The Principal of Phil- 
ips Exeter Academy, and the Director of Instruc- 
tion for the Denver City Schools completed the 
membership. Let me now outline the selection 
procedures they used and then share with you 
their answers to three questions over which we 
had been loosing sleep. 

At the outset the CEEB Scholastic Aptitude 
Test yielding separate verbal and mathematical 
scores опа 200-800 scale was administered to 
13,112 high school students in January andMarch 
1955. After scoring the test papers, total verbal 
and mathematical scores were computed for all 
candidates and candidates were ranked on this 
basis. A cutting score of 1345 (675 verbal ог 
mathematical) was set to yield atleast 1000 semi- 
finalists for the available 100 awards. Adjust- 
ments to retain the original ratio between the 
sexes and to assure adequate geographic cove r- 


1 
may bring into focus 


an 
its memb 
combination 
from all of t 
Dame, Bryn 
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mi-finalist population to 1414. 
ше ded selection involved the 
use of a weighted composite made up of twice 
the verbal score plus the mathematical score 
(with a weight of 2), the candidate s high school 
class rank relative to class size (with a weight 
of 3), a scaled rating by the school principal on 
the candidate’s academic ability (witha weight | 
of 1), and a scaled rating by the School p rinci- 
palon the candidate's personal and social adjust- 
ment (with a weight of 2). Such а composite was 

computed for the 1414 semi-finalists, and the 
ranking of candidates within the state ассога- 
ingly led to Ше choice of about 500 finalists. At 


this point, to assure fairness and equitable hand- 


ling, two categories of those semi-finalists fall- 
ing below the cutting composite score for final- 

ists were reviewed. Those cases with very high 
SAT scores and those identified as class vale- 

dictorians were studied and included 
ist group if it seemed propitious to до so. The 

finalists, with these additions, number 585. 

The final step for the Selection of the 100 win- 
ners was built on subjective, intensive reading 
by the selection committee of the 585 finalist 
case files. Each file contained two descriptive 
forms, one completed by candidates about them- 
selves and the other on their behalf by principals. 
Committee members worked in teams of two, 
each reading folders independently, and, оп а5- 
sessing Ше candidates’ personal qualities, made 
а joint evaluation on the following four -point 
Scale: (1) select, willing to defend, (2) select, 
(3) borderline between winner and non-winner $ 

These four poi 


evaluation had equal weight with Objective “ас. 
turial’’ evaluation. The sum of these evalua. 
tions then became the basis for the fi 
of candidates. After 


recommended the top 
alternates. Of the 10 
Scholars for 1955, 82 
ommended for award, 
alternate list. 

The foregoing experience has Suggested зеу- 
eral considerations which may be regarded as 
partial answers to the questions previously 
raised. 


How may committees be sure of fairness in re- 
moving a candidate from further considerationas 
a scholarship competitor? 


in the final- 
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Use a scheme of successive hurdles with at 
least some hurdles having multiple criteria. 
Pass over each hurdle a large number of re- 
maining competitors. (Large in comparison 
with the number of available scholarships. ) 


- Provide by-passes to feed back into the com- 


petition those cases for whom “composite 
predictions’? may mean injustice. 


How does а scholarship committee make dis- 


tinctions among highly competent competitors for 
scholarship? 


1. 


сл 


What goes into the 
risks? 


T; 


Eliminates as rapidly as possible those who 
with fairness may be eliminated so that ener- 
gies may be directed on finite evaluation 
among those of extreme competence. 


- Uses test instruments which will provide a 


spread of scores at the top end of the distribu- 
tion. 


- Ties criteria tightly to the purposes setby the 


donor group and orders the criteria in accord- 
ance with the relative importance to the group, 
and weights evaluation accordingly. 


- Brings a wide variety of evidence—test and 


non-test—to bear on foc 
distinguishing traits. Draws this evid ence 
from the candidate through perso nal data 
cipal and teachers 

school record and staff 


using differential and 


Uses a dual approach involving both objective- 


ly predictive and clinically analytical types of 
activity. 


selection of best scholarship, 


Adequate means for reducing a varied popula- 


tion having a wide geographic spread, varied 
academic and personal characteristics to a 
basis for comparability. 

alysis of known predictive fac- 
elate to the scholarship candi- 
hances for college success. Re- 
prediction to quantitative terms. 
of secondary school level of per- 
formance, ac 


Determination of an "index of likely success” 


THE ROLE OF EVALUATION IN THE DEVEL- 


OPMENT AND IMPRO 
HIGHER EDUCATION 


AL PROGRAMS OF 


VEMENT OF REGION- 


A. J. BRUMBAUGH 
Southern Regional Education Board 
Atlanta, Georgia 


_ EVALUATION PLAYS a very important pa rt 
in the development and improvement of regional 
programs in higher education. In this paper I 
shall discuss the subject within the general frame- 
г. of Ше operations of the Southern Regional 
ducation Board. The activities of the Board con- 
pus а systematic and coordinated approach to 
ti € developmentand improvement of higher educa- 
ion in the fourteen states in the South. The concept 
of evaluation as it applies to the activities of the 
е involves less of precise measurement and 
n than is indicated in the preceding papers. 
al involves the identification of higher education- 
1 needs in the region, the determination of ex- 
sting facilities to provide for the needs and pro- 
eii Гог bridging the gap between the needs 
present facilities. 
tin To consider the role of evaluation in the ae 
it Е of the Southern Regional Education Boat 
f 15 necessary to first summarize the major | 
ұраны of the Board. Briefly stated, they аге: 
t to serve as a clearinghouse for information 
Meam MT significant activities іп higher ed- 
sea, Oi 19) to provide facility and staff for ав- 
ne dus needs and developing program? to meet 
m ls of higher education in the South; (3) to >. 
ии inter-state arrangements for regiona 
f ucation services in institutions; (4) to act e 
Scal agent in carrying out such arrangem ents; 
al to serve as a research facility of institution- 
fied. regional problems relate e | mgr -" 
v of higher education; and (6) to assis lard 
tute consultative services to State? and wre’ 
са ions on problems of major regional signi" 
Bn related to the improvement of higher 
tion in the South. 
misi er of considerable length 
tion i to discuss adequately the role Шо 
п in relation to each of these fun ns 


der that imi he time 

I may stay within the limits of the ЧЕ 
allotted 1 shall focus my presentation primarily 
noted, 


on the second and fifth of the functions 
era ely, assessing needs and developing. Pe 
Bom. to meet needs of higher education ! 
cipi to serve as a research 
Кае and regional problems 
not Ovement of higher education. 151 ап 
mis briefly the necessity for appral Š ТАР ams 
of rshalling social forces in order that prog 
action may be effected. 


To assess the needs and develop programs to 
meet the needs of higher education in the South is 
an evaluative task of major magn itude. It in- 
cludes research to project as accurately аз pos- 
sible population growth and economic develop- 
ment as a basis for forecasting undergraduate 
and graduate enrollments and for determining 
the need for technically and professionally trained 
ппе1 in the light of economic changes. From 
these facts are determined the needs for new fac- 
Шу mem bers, new educational programs, in- 
creased physical facilities, and additional finan- 
cial resources. The approach to a problem of 
this kind is complicated by the variables involved. 
First of all the statistical techniques employed 
must be defensible or else all of the conclusions 
derived from the data will be open to question. 
Second, certain assumptions whose validity has 
not been demonstrated must be made. Forexam- 
ple, it is estimated that the Southern region faces 
a deficit of between 27,000 and 28, 000 college 
faculty members by 1965. This is an evaluative 
judgment based on statistical evidence. The evi- 
dence includes the projected growth in enro 11- 
ments in colleges and universities of the 50 uth, 
the faculty-student ratio, the teaching loads typi- 


perso 


cal of Southern institutions, and the potential out- 
put of college teachers by the universities of the 
South. There are other assumptions too thathave 
to be made—such as the rate of student migra- 
tion into and out of the South and the percentage 
college аве youth who will enter college. The val- 
idity of some of the assumptions has not been es- 
tablished, therefore the conclusions must remain 
tentative. 

The Board is also called upon to dete rmine 
s for programs in various profess ional 
For example, within recent years the 
se in one state as to the ne ed fora 
hitecture and in another state as to 
the need for а veterinary medical school. In each 
instance the Board was asked to assess the needs 
is and to advise the states con- 


need 
fields. 
question aro 
school of arc 


опа regional basi 
cerning the proposed programs. In both cases it 
was shown that the regional facilities for training 


people in these fields were adequate and that the 
states could much more economically use region- 
al facilities than provide duplicate programs of 
their own. During the first seven years of the 
Board's operation more than thirty professional, 
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i fields have been ex- That the Board of Control for Southern 
ева in these fields the Regional Education be asked to appointa 
Ex ust endeavor to find answers to many commission on nursing education as Soon 
о that will throw light on thecurrent sta- аз possible for the purpose of s tudying 
fui of the field under consideration and the fu- nursing education and identifying the ways, 
Lire reeds in the field. Such questions as the fol- if any, in which regional arrangements 
lowing are illustrative: would be beneficial. 


1. What is the potential demand for proíession- 
ally trained personnel in this field? | 

2. What is Ше potential student demand in the 
field? | Ек 

3. What is the present student capacity of insti- 
tutions in the region offering programs in the 


Other nursing groups gave strong Support to 
this request. In response to the request the 
Southern Regional Education Board appointed a 
Committee on Nursing Education. The functions 
of this committee Were as follows: 


field? 1. To assess regional needs for expansion and 
4. What is the quality of existing programs in improvement of nursing education through 
the field? a. Identifying needs for nurses able to execute 
5. To what extent do existing programs in the various responsibilities 
field provide complementary Or duplicate b. Identifying kinds and capacities of training 
opportunities for specialization? facilities needed to meet these needs; 
6. What cooperative arrangements among insti- с. Identifying needed research and other activ- 
tutions and states would allow compl emen- ities; 
tary strength of institutions to be combined d. Defining the gaps between present facilities 
or developed? and needed facilities, both in sc оре and 
7. What additions, if any, are needed to improve quality 


b. Action by individual States or institutions; 
C. Action by group. 


S of states or institutions. 
9. What previous experience of institutions and 


government can be drawn upon in assessing 
current needs in the field? 


" tion, includi 
In assessing needs the first step is to ident- i; ҮЛЕ the need 


ify the field of Specialization to be Considered sound develop алате! p He to сте 
Шеп to formulate the kinds of questions just not- meeting emer ed € profession From this 
ed. Priorities must also be established amon Бей severa] Suggestions 

the fields under consideration. The Priorities 

of subject matter fields arrived at by the South- i реа тар кенеша for nursing educa- 
ern Regional Education Board are dete rmined of the master's es > е study to the level 
largely on the basis of which fields will m ost sentatives of collegiate soho sidered by repre- 
likely elicit a response from the colleges and meeting with representati 9015 of nurs ing 
universities, state governments, andthe gen- 2. That the Same group als ives of the Board 
eral public. Once the fields to beassessed have bility of establishing a Е Ше ровві- 
been determined, the next Step is to decide on region which woul Зе ето in the Southern 
the procedure to be followed in answering the ing, actas a Clearinghous ти іп nurs- 
questions. This phase of the evaluation can best assist in Dreparin tea. Hd research and 
be presented by referring to Specific instances this Professional fiela S to до research in 
in which the process has been completed. One і 
of the best illustrations is in the field of nursing At the same meetin 
education. 


а competent person be empl 
This project grew out of an action taken by 
the Southern Regional Conference of State Leagues 
of Nursing Education at its meeting in Atlanta on 
November 11, 1950. The motion passed at that 
meeting read: 


' after visits 
В universiti es 
егуе the ге- 
ation in nursing, 


ties seem best Prepared 
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2 ct research, service, and education. The 
ance та staff person appointed in ас cord- 
imn : the Committee's recommendation, in 
тік тыл on with representatives of various pro- 
Signed Ë groups, prepared а questionnaire de- 
the ге Е discover which of the universities in 
vices gion were interested in offering such ser- 
istics pe were contemplated and what character- 
readine these schools appeared to support their 
сан Ge to begin such service. The data pre- 
au pie B the universities which indicated such 
е Рем were analyzed, summarized, and 
member; Subsequently, the professional staff 
the purp on the project visited each school for 
они у of testing by direct observation and 
questi ews the findings derived from the initial 
Sions шшен study. The findings and conc lu- 
ence of us reached were presented ina con fer- 
ing ba representatives of the institutions ha v- 
rom Sic degree programs in nursing in 195 E 
tisse үл eleven schools that initially ех- 
grams 1 an interest in providing graduate рго- 
institute, nursing or in establishing 2 research 
ia em е, six were finally selected. The criter- 
es E oyed in making the final selection of 
е institutions were: 


оп of recog- 
] standing; 

work as ev- 
ncil, dean 
дераг t- 


ni institution of higher educati 
- Instit academic and professiona 
im ДА interest in graduate 
and =. by ап existent graduate cou 
и Ed and provision for inter- 
3. Avail Б шига. | М 
Size ability of a reference library of pu Е 
ards and quality according to accepted stan 
4. киа сініп its building. 
сдаёт appreciation of the е 
ing of m of the Southern reg п 
these, stitutional responsibility 
түсүн of opinion favorable to the антен" 
might + professional programs as ше s 
uate у vay from traditional programs g 
6. work, 
ina sumption of some ability to contribute » 
gradi Cial support of this additional ** el 
Т. Ау “uate study. і 
ос Оу of services such 45 couns па 
to inst?! recreation, and the like, inaddi 
8. The struction. 
istence of an autonomous $C 
реа! nursing with a sound basic paccalau- 
9. Accredited и preferably already 
iep tunity for ample clinical € 
portun ity, including public health, 
to th ity to study well individuals та 
OSe who are ill. 


ducational ап d 
ion and a feel- 
o meet 


ddition 


Now с; de- 
Velopin Six universities are in the procesi n 
$ advanced programs in nursing educa 
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leading to the master's degree. 
This approach has had several important bene- 


ficialresults. Among them are the following: 


1. It has brought together representatives of the 
profession of nursing education and of the uni- 
versities to explore jointly the needs in this 
field and to identify the resources of the re- 
gion to meet the needs. 

2. It has been a means of securing financial sup- 
port from two of the major foundations. The 
Kellogg Foundation has provided approximate- 
ly а half million dollars for a five-year period 
to underwrite the cost of instruction. The 
Commonwealth Fund has provided scholarship 
and fellowship funds in the amount of twelve 
thousand dollars annually to each of the six 
schools. This fellowship program is now 
in its third year. The Commonwealth Fund 
has also provided from twenty-three to twenty- 
four thousand dollars for each of the first two 

r the conduct of seminars. It is anti- 

cipated that this support will be continued on 

a reduced scale with the idea that the seminars 

should eventually become self-supporting. 


years fo: 


ce to evaluation, one further fact 
d. A special evaluation commit- 
tee has been appointed to make an annual apprais- 
al of the progress of the seminars and of the edu- 
Also, forms have been developed 


cation project. 
for recording the progress of students, andplans 
are underway to follow up for a period of several 


years individuals who complete the programs and 
enter positions in the field of nursing educ ation. 
an is being developed for a full eval- 


Finally, a plan 15 я 
uation of the project at the end of a five-year per- 
iod, the term of the Kellogg grant. This is an ex- 


cellent illustration of the development of a pro- 
ject in which evaluation is basic. 

Now may J turn toa second illustration of a 
somewhat different nature. I refer to the South- 
ern Regional Education Board’s project in mental 

e fall of 1953 the Southern Gover- 


health. In th ) 
nors requested the Southern Regional Education 


Board to study the needs and resources in train- 
ing and research in mental health programs of 
the sixteen states. This project grew out of a re- 
ort on the training and research in state mental 
health programs prepared by the Councilof State 
The directive to the Southern Re- 


Governments. 
gional Education Board from the Governors pro- 
vided that the Board: 


With referen 
needs to be note 


in an immediate survey of facilities 
he training of psychiatric personnelin 
the South, and that it report to this Confer- 
ence those institutions best qualified to take 
additional students in the psychiatric disci- 
plines from states which have по such train- 


ing facilities. 


Beg: 
for t 
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That the Board also initiate à survey of 
institutions doing mental health research 
in the South, and that it recommend to 
this Conference those institutions cap- 
able of being enlarged to do addtional re- 
Search. 


That upon completion of the above sur- 
veys by the Board, but in any case not 
later than July 30, 1954, а Southern Re- 
gional Mental Health Conference be held 
to discuss the surveys and to draw up in- 
terstate contracts in mental health re- 
search and training. 


That in the interim the individual states 
make official surveys of their training 
and research facilities with particular 
emphasis on raising the menta] institu- 
tions in every state to the level of resi- 
dency or affiliate accreditation, andthat 


That the Southern Regional Educa tion 
Board be requested to reportthe results 


А commission composed of fourteen dis tin- 
guished persons representing professional Orpo- 


vide for these needs in the region. 

Five technical panels were also setup to give 
attention to special problems not Covered by state 
Surveys. Each panel presented its findings to 
the commission. The Conference on Mental 
Health Training and Research, attended by some 
170 persons, held in the s ummer of 1954 re- 
ceived the findings and recommendations of the 
state committees, the technical panels, and the 
staff. Finally, in September 1954 the findings 
and recommendations previously developed were 
presented to 56 legislators from the Southern Re- 
gional Compact states for their critical study. 
They endorsed the recommendations and com- 

mended them for consideration by the Gover- 
nors of the sixteen states concerned. Now these 
recommendations are being put into effect. 


to provide for them in many other fields. The 
plan of organization varies from one project to 


and the development of plans for giving effect to 


1, 


, 


This is an- 
protecting апа improving the 
The Board foresees 


This approach points in 

intra-institutiona], Statewide 
апа regiona] Studies. 

The nature of needed studies апа experiments 

major problems con fronting 

Ше United States, namely, 


therefore, to hold and to 
use of superior teachers, 
- The growing complexity of th 


1 Increased Offering, 
and Specialized Courses, 


е plans of į 


тойы nstituti - 
ization and management tutiona] organ 
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the urgent need for carefully controlled research 
and experimentation in such areas as the selec- 
tion, preparation, and use of faculty members, 
Curriculum re-organization, methods of teach- 
ing, intra-institutional and inter-institutional or- 
ganization and administration. To be more spe- 
cific, what combination of qualities and proced- 
ures makes for superior teaching, what isa rea- 
Sonable faculty load, what use can be made of 
television and other audio-visual aids to extend 
the compass of superior teachers, how сап econ- 
Omies and improved effectiveness be achieved 
through curriculum organization, what plans of 
Space construction and utilization contribute to 
селани effectiveness and economy, what аге 
€ merits and limitations of various plans of in- 
Stitutional and statewide administration? With 
reference to the research and experimentation of 
the kind just outlined, the Board will serve as 
the facilitating agent. It will stimulate institu- 
oe and state boards to explore these problems 
ate Оп request, will aid in designing appropri- 
E research and experimentation. The Board 
ao will undertake projects in this area only 
Vies it is requested to do so by the institutions 
p: the states of the regions. The Boardis still 
ev the early stage of promoting the much needed 
arp анте research and experimentation in this 
кои anticipated outcome of the Board's p T°- 
ins is generally a program of action. But in 
nies that the Board may achieve its predeters 
Нор. Purposes it must identify and gear itsel " 
tur he dynamic and powerful elements of ки. 
ша е of the states and of the region. Especia y 
pon. Ortant is the appraisal of these cultural com- 
fom às to their relative importance, AE 
storable or antagonistic attitudes, and the Р 
llity of melding them into a régional aue. 
in Po š of the most important of these elem en 1 
irs Southern region are state governments an 
e Colleges and universities. How to арр 
ow ative dynamics of these two elements : а: 
е | fuse or coordinate them in the interesi Да 
і Ocial and economic development m ыу 
een Bi ОГ assessing these cultura 
ang p Ployed: viz., the judgment of edu 
е POlitica] leaders and practical experie 
ег of them scientific in the strict sense 9 


e : of 
istrative р To gear into the dynamics 78 
пе! і ments has р 
Senteq ersonnel in state govern ит? 


24 по great problem because th 
ап, giona] Education Board is the agent of the pa 
States ^ created by the governors of the comp 
Who h : But the election of a new governs, 
Boa, ad nothing to do with the creation О 
Ч and who knows little about its fun са 
owe à 
ae re quires 
n which the 


a 
Его, &reatly impair the dynamic 
e ide Such a situation immedia 
ntification of avenues throug! 
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governor may be given an understanding of the 
Board's program and may become favorably dis- 
posed to it. 

To tie the Board's program into the legislative 
bodies of the states is another matter. One ap- 
proach that the Board has developed is the Legis- 
lative Work Conference—a conference in which 
about 60 legislators from the compactstates take 
part each year. Consideration of regional prob- 
lems in higher education by this group has been 
an important means of creating common inter- 
ests and understandings that transcend state 
boundaries. 

An appraisal of these procedures has indicat- 
ed, however, that the higher institutions through 
their presidents and boards of control must some- 
how be brought into the picture more directly. 
This is especially difficult because of the variety 
of plans for the administration of state- supported 
higher institutions. One idea that is being tried 
experimentally is to request the presidents of un- 
iversities who are members of the Southern R e- 
Education Board to invite members of their 
boards of control to attend the Legislati ve Work 
Conferences. Whether this will bea means of 
fusing another element into the regional pattern 
the Board is attempting to develop remains to 
be seen. If the plan appears to be sufficiently 
promising it may be extended to include members 
of boards of control of other universities in the 
region. н 

Т seems quite clear Ша! as time goes on it 
will be necessary to identify other dynamic ele- 
ments in the culture pattern of the South and to 
attempt to marshal their forces in support of the 
Board's program. There may be better methods 
for doing this than those which the Board has re- 
lied upon but so far those better methods have not 


me to light. 
d tant to note that the Board's contin- 


It is impor Г A : 
uing assessment of higher educational needs in 
the South and the development of programs topro- 


vide for identified needs currently involves about 
twenty committees and commissions with a total 
membership of nearly 300 professional and lay 
persons. This number does not include par tic i- 
the Legislative Work Conferences that 


ts in ignifi 
E held from time to time. Significant also are 


some of the outcomes of these exploratory and 
evaluative activities; for example, contract pro- 
rams among selected universities of the region 
in the fields of dentistry, medicine, social work, 
and veterinary medicine now enroll about 1000 
students to whom the advantages of education in 
these professional fields were not available in 
their respective states; and memoranda of agree- 
ment among universities offering specia li ze d 
programs in city planning, forestry, marine sci- 
ences, nursing, petroleum sciences, and pulp 
e already been adopted. Ехріога- 


aper hav c FUN 
ша Е dies still underway will in all probability 


gional 
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lead to additional memoranda. From these ac- 
tivities have also come publications and consul- 
tations designed to aid institutions and profes- 
sional groups in identifying problems and in find- 
ing solutions to them. 

I have sketched very briefly three types of 
evaluation that are involved in the development 
of regional programs of higher education—a s - 
Sessing regional needs and resources to me et 
those needs; stimulating and aiding institutions 
to assess by research and experimentation the 


basic premises underiying instruction, curricu- 
lum organization, and administration; andas- 
Sessing the dynamic elements of a regional cul- 
ture pattern that may be drawn upon to put pro- 
grams into effect. I have also indicated ina few 
words some of the achievements ina r egional 
approach to the improvement of higher educa- 
tion. These illustrations will suffice to support 
the statement I made at the beginning, na mely, 
evaluation plays an important role in the devel- 


al programs of higher education. 
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Pan beo b 
о fifth, two sixth, and two 


THE ROLE OF SIXTEEN MILL 
I 
TION PICTURES AND Mise ашы pod 
PICTURES IN SCIENCE UNIT VOCABU 
LARY LEARNING AT GRADES FIVE, 
«ІХ, AND SEVEN | 


LOUIS ROMANO 
University of Wisconsin 


Ванные 
efinition of the Problem 


THIS і 
ої Иса is an attempt to identify the rol? 
een millimeter motion pictures and рго- 


jected sti T 
Still pictures in science unit уоса bulary 
dseven. This 


nd possible 
ро children 
ce units 
ес still 


n retain more 
when motion 


The sah; 
© subjects in this study were 
Eroups i 

DS in the public schools of Shorewood and 


Вікові 

із : 2 z 

h Bay, Wisconsin. These groups Were 
n experi- 


d ex- 


Proje 

3- pe] Still picturcs (film strips 2X2 and 

байле и arid ER ND used with the 

menta] projector) were used only in the experi” 
as the experimen” 

ts, SUPP le- 

dstudents, 


th 
© experimental factors. 


бірлі 
lcanc» of the Problem 


It 

not al be pointed out tha 

Single a ірі to determine Ше е 

Ritter АВИВ material over 

and the “gn as slides, demonst 

а, 90 188 more traditiona 

ОГ textp, əs using verbal instruction 
OOks or supplementary reading. 


t this study do ев 
Несіуепе55 ofa 
other vis па 

rations, map?» 


» 
£ this art 


HALT 
fo 
Otnotes will be found at the end 0: 


it attempts to determine the е i 
audio-visual utilization in .. а 
visual materials are employed over an ein д 
ual utilization in which а limited number d aero 
visual materials are used. ра121* states ачу" 
experimentors often neglect to establish no ы 
schoolroom procedures in their inves dee 
which may result in lessening the value meum 
data. The procedures in this study seem t Е 
low a realistic classroom situation is Pis 
schools use some audio-visual materials ew 
cording to various surveys many schools do m 
have an audio-visual program which include 
the use of several audio-visual materials in the 
instructional program. If the findings of thi E 
study should point out that better learning т 
achieved when certain audio-visual mater ЖЫ 
аге employed throughout a unit of study, it might 
suggest that these materials be included as d - 
tegral part of the instructional program. є 
In previous experiments, empha i 
placed on the values of films for parting "un - 
tual information. 2 This study may tend to gi Ps 
evidence that the use of audio-visual materials 
in the instructional program contributes to bet- 
ter learning experiences. Educators cannot ге- 
frain from producing research that points out the 
effectiveness of an instructional tool. This is es- 
pecially true because many magazine articles 
and newspaper stories point out the public’s con- 
cern for the teaching of the fundamental s kills 
The findings of this study may be used by educa- 
tors in informing the public that the use of audio- 
visual materials helps children in gaining the уо- 
cabulary comprehension which is v ital to an 
basic skills program. y 
Classroom teachers are concerned about the 
ability of boys and girls to acquire and retain 
the vocabulary taught during an instructi onal 
unit of study. The findings of this study ma 
point out that the vocabulary of a unit of nm 
may be learned when an aggregate of audio-vis- 


iclee 
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ials as defined for the experime ntal 
Pub peor in the teaching-learning situation. 
Learning the vocabulary of the unit of study for 
the purpose of knowing words per seis mot к 
important as knowing Ше words which will B 
used to grasp the important concep ts ,under 
standings, or generalizations of the unit of stud y. 
Acquiring the vocabulary in the unit of study 
might help children grasp the meanings of the 
generalizations more readily. 


Limitations of the Study 


In spite of careful planning by the participat- 
ing teachers and the investigator, this study is 
not without limitations. 

Probably the most obvious limitation might 
seem to be the small number of students from 
which the data was obtained. This study was lim- 
ited to the collection of data in the present situa- 
tions, and is best described as a descriptive 
study. 

Another limitation grows out of the fa ct that 
this study is limited to boys and girls in the mid- 
dle to upper class cultural backgrounds. Both 
communities, Shorewood and Whitefish Bay, en- 
joy many cultural and social advantages which 


one might not find ina large city with its hetero- 
eneous population. 


с n Ше objective tests 
were obtained from the text materials included. 


in the science units as taught in the fifth, sixth 

and seventh grades. A more comprehensive pic- 
ture would have included determining whether or 

not children acquire and retain the vocabulary in 

other subject areas such as Social studiesand the 
language arts. To a certain extent vocabulary 

used in the science unit of Study is also included 

in other areas of study, but this is limited. 

A limited number of appropriate films and 
filmstrips for various units of study in elemen- 
tary science made it difficult for the participa t- 
ing teachers to obtain the best audio-visualmate- 
rial for the instructional program. 


Procedures Employed in this Study 


Rotation Technique. The rotation-group tech- 
nique of experimentation was used in order to 
minimize the effect of several uncontrollable fac- 
tors such as initiative, industry, or study habits. 
The rotation method **.... involves an exchange 
for the groups at intervals, in terms of thepro- 
cedures followed. "4 This technique was us ed 

with both the classes and the teachers. During 
each unit of study for each grade level, one class 
was designated as the **control"' group while the 
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other class was designatedas the ‘‘experimental” 
group. The ‘“‘control’’ group was the group 
which used only the following audio-visual mate- 
rials: bulletin boards, blackboards, charts, 
models, flat pictures, and field trips. The “ех- 
perimental’’ group not only used the materials 
listed for the control group, but alsoused six- 
teen millimeter motion picture films and project- 
ed still pictures. 

Selection of Groups Participating. Equal num- 
bers of children in the fifth and sixth grades 
from the Lake Bluff School of Shorewood, Wis- 
consin, and from the seventh grade from Cum- 
berland School of Whitefish Ba y, Wisconsin, 
were included. These groups were equated with- 
in feasible limits on the basis of I. ©. scores and 
Standardized reading vocabulary test scores. 

The Selection of the Vocabulary Words and the 
Construction of Tests. Prior to the experiment, 
the investigator reviewed all of the science text- 
books from the third grade level through the 
ninth grade level to assemble the vocabulary е5- 
Sential to the understanding of the core ideas to 
be developed within a unit of study. In addition 
to looking through the available textbooks, thein- 
vestigator reviewed each article in the World 
Book Encyclopedia that pertained to a particu- 
lar unit of study. A review by the investigator 
of all the available textbooks in each of the par^ 
ticipating schools from the third grade level 
through the ninth grade level, was designed to 
provide a range of science words from the third 
through the ninth grade level, 

These lists of words were then carefully ге- 
viewed by a committee made up of teachers par- 
ticipating in this study, Also, teachers who were 
especially interested in the teaching of science 
апа had had sever 
field, 
fully. 


by this commit! 


each unit 
E possible the construction of a 507 
item vocabulary test. Wherever possiblea word 


For example, 
part of the vocabular fr 3 a 
of study, Sound inelo om the sixthgrade u 


-Sound, des the following: 
reception loudness decrease 
range А Spread velocity 
transmit mute Speed 
amplitude intensity amplify 
Supersonic audio 


From the above lis 
ers selected and desi 


» One being the corre 
Whenever possible а 
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or nearly the same meaning Was obtained from 
the list of 250 words. This word was considered 
the correct response. 

The tests used as instruments of measure in 
bee study were of the multiple-choice objective 

ype. 

. Validity and Reliability of the Test Items: A 
high degree of curricular validity could be as- 
Sumed since the vocabulary WaS closely correlat- 
ed with the curricular content of each unit of 
Study. 

Reliability was estimated by administering 
the vocabulary tests to groups not participating 
inthis study. The split-half method was used. 
This necessitated obtaining separate scores on 
Odd and even-numbered items. А coefficient 
of correlation was obtained between these two 
Scores by the product-mom ent method. By 
means of the Spearman-Brown formula, an esti- 
mate of the reliability of a test as longas thetwo 
halves combined was obtained. я 

Administration of the Vocabulary Tests. ргі- 
ог to teaching the science units, tests foreach 
grade level were given to the control and experi 
mentalgroups. These tests were administered 
two hours apart so as to reduce practice effect. 
The scores are designated as the “рге” test 
Scores". Atthe termination of each unit of study 


Which took five weeks, ‘‘final tests" were given. 
: the par tici- 


These scores 


ме To insure objectivity, teac 
is study did not check these рар 


answer sheets were worked out, 2 
seanswer sheets. 


Were scored on the basis of the 
The Selection of the Science Units of Study: A 
Committee of teachers selected two units for 1 
each grade level based on the following criter n 
а availability of audio-visual materials selene 
D the various umita of өршу, and (0) ELSE с 
Previous experiences іп the particular unit б! 
Study. Specific problems to be covered in еас 
toi of study were defined by the teachers so 25 
9 insure some degree of uniformity in both eX 
Perimental and control groups. 6. 
th The Selection of Audio-Visual Materia 
Ше Experimental Group. The criteria бе) 
pan ed by the participating teachers include ЕА 
p. the audio-visual material contribute п, a 
oe of the unit of study? (2) = =: 
615041 materi it the experiences, 
sal ani aoe тегі of the students? 
di ше audio-visual material accurate anda a 
een (4) Is the audio-visual material ал 
tar Any audio-visual materials peery ps 
nd pm meet the above c riter ia W 
is study. би 
ri The procedure for showing audio-visual Ша 3 
р als was carefully planned by the group- iege 
Tocedures were demonstrated in 2? in-se 


for 


deter- 
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meeting. 

Procedure in the Selection of Pupiland Teach- 
er Responses. Subjective evidence was gathered 
on the reactions of pupils and teachers to the util- 
ization of audio-visual materials in the 
classroom. Specifically, teachers were asked 
to respond in writing to the following question: 
¿What reactions do you have concerning teaching 
а unit of study in whicha limited number of audio- 
visual materials are used as contrasted with a 
situation inwhich several audio-visual materials 
are used. ” The reports were then submitted at Ше 
termination of the ten-week experimental period. 

The boys and girls were asked to react to the 
following question: «What reactions do you have 
concerning the first unit of study in science and 
the second unit of study?" Responses to this 
question were recorded immediately by the раг- 
ticipating teachers, or, when possible, a stenog- 


rapher was employed. 


presentation of Findings and Interpre tation: 


Test Results 


The findings for the fifth, sixth, and seventh 
grade groups using the rotation-group technique 
are summarized in Table I. 

Table I points out that the fifth grade classes 
in the unit on Electricity had a mean score of 
1.24 words on the pre-test for the experimental 
group, and а mean score of 11. 45 for thecontrol 
group. In the final test scores given five wee ks 
after the pre-test, the experimental group 
scored a mean of 23. 62 words while the control 
group scored a mean of 21.93 words. Inthispar- 
ticular unit the experimental group hada mean 
gain of 16. 38 while the control group had a mean 
gain of 10.48. The experimental group intheunit 
on Electricil had a mean gainof 5. 90 words over 
the control group. | 

In the unit of study, Rocks, the experimental 
group had a mean pre-test score of 15. 06 while 
the control group had a mean pre-test score of 
17.40. Inthe final tests Ше meari scores were 
29. 38 for the experimental group, and 21. 10 for 
the control group. This represents a mean gain 
of 14. 31 for the experimental group, and a mean 

in of 3. 76 for the controlgroup. The experi- 
mental group then had a meangain of 10. 55 words 


over the control group. 
The same table summarizes the findings for 


the sixth grade unit on Astronomy. Inthis unit 
of study the experimental group had a mean pre- 
test score of 15.68 while the control group hada 
mean pre-test score of 14.00. The finaltestfor 
the unit on Astronomy produced the following 
test scores: experimental group a mean 
score of 34. 84 and the control group а mean 
score of 21. 72. The experimental group had 
a mean gain of 19. 16 while the control group 
had a mean gain of 7.72. The experimental 
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Егоцр then had a mean gain of 11. 44 words over 
control group. 
"E- E unit of study, Sound, the experimental 
cont 1 da mean pre-test score of 13.88 while Ше 
in the ti group hada mean pre-test score of 15. 08. 
ee tests the meanscores were 30. 72 for the 
this imental group and 21.52 for the control group. 
oe a meangainof 16.84 for the experi- 
trolgr group, anda mean gain of 6. 45 for the соп- 
Ione oup. The experimentalgroup scored 10. 39 
е words per child over the control group. 
"s the seventh grade on Air the experimental 
EE a mean pre-test score of 22. 68 and à 
of 18. inal test score of 35. 68. Thisisameangain 
Störe 00. Thecontrolgroup hada meanpre- tes t 
24 А of 19. 80, and a mean final test score of 
4.36 6. Thecontrol group showed a meangain of 
had à This shows that the experimental group 
I gain of 8. 64 over the control group. | 
ex n the seventh grade unit of study on Soil the 
a oa mental group had a mean pre-test score of 
1.68, and a mean final test score of 34. 20. 
inste © а mean gain of 11.56. The controlgroup 
a e had a mean pre-test score of 21. 68, and 
Sents n final test score of 25.48. This repre- 
parin: Tome of 3. 84 for the control group. Сот” 
Шатев һе mean gains, Ше experimental group 
та 7.72 over Ше control group: | 
achieved II summarizes the percentage of gain 
trol by the experimental group over the con 
y e hab in the amount of vocabulary acquir ed 
hat оуз and girls in these groups. _ 
edi tmay be interpreted from the data present 
п Table I? АП experimental groups using the 


motion pj ill pi es 
picture fil jected still pictur 
ilms and рго) 48 to 11.44 


This indi- 
dover the 


Chi groups. Thus it may be conclu 
m of this particular population а‹ 
en E the vocabulary in à unit 0 
res iy. picture films and ргоје 

ix metus foie сеп. 
of s following the comp 
азу у Ше boys and pee were given сетей 
mine the on the particular unit 50 25 to de тж 
Period е amount of vocabulary retained over t Yo- 
Sults a of time. Table Ш summarizes "m 

A Chieved in the re-test vocabulary tes! = i 
test aoe examination of the re-test and ep за 
Рене тен shows that re-test scores of the ж 
“nits Peu group in the Rock and Astronom 
all the Study for the experimental group an iim 
fester, MM of study of the control groups, ant 
Core Scores were higher than the on з 
Perime, There was a loss in retention for 
The de group in only two of the units of 500 
Crease lowing may indicate reasons for thi 
Ot te 11 Scores: (1) the science program од. 
Alle Pminate following the experiment T aged 

asses continued with thescience 1n? іг 


tu; 
letion of the unit 


cted still ріст 
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tional program, and throughout Ше instructional 
program classes utilized many audio-visual m a- 
terials including films and projected still pic- 
iures. An examination of the units of study and 
audio-visual materials used following the experi- 
mental period show that some of the vocabulary 
words included in the vocabulary tests were used. 
This may account for the gains in the re-test vo- 
cabulary scores for both the control and experi- 
mentalgroups. (2) During the period between 
the pre-test and the final test both science and so- 
cial studies were taught as part of the dailyin- 
structional program. An attempt was made so as 
not to include social studies units which were 
closely allied or related to the science units of 
study. This procedure may eliminate to а сег- 
tain extent the duplicat..on of terms or vocabulary 
luded in the vocabulary tests. 


which may be inc 
Following the final tests the social studies and 


science programs may be correlated, but in any 


case both classes received the sameor similar 


activities. 
‘An analysis was done so as to check on the 


ties that the experimental group gains 
could be accounted for by the presence of key 
words in the media to which the contr ol group 
may not have had access. 

The sixth grade unit of study on Astronomy 
was chosen to study carefully the vocabulary in- 
cluded in the audio-visual materials which was 
identical to the vocabulary inthe test. Narra- 
tions of films and filmstrips were obta ined. 
Many duplications of words were found, but o n- 
ly 138 different words were included in audio- 
visual materials 45 compared to 250 words inthe 
vocabulary tests. This is 55% of the total num- 


ber of words included in the Astronomy voca bu- 
Of the 138 words only 14 were key 


possibili 


lary tests. 
words or only 28% of the 50 key words included 
in the test. 

һе data show that the ехрегі- 


An analysis of t 
mental group and the control group had approxi- 


mately the same means in the pre-test, 4. 84for 
the experimental group, and 4. 08 for the control 
group. In the final test, the experimental group 
scored a mean of 11.50 while the control group 
scored а mean of 6.84. This is a mean gain of 
4, 66 words over the control group. The total 
gains for the experimental group in this unit of 
study was 19. 16 on the entire test, whereas the 
gains on the key words was only 6. 66. 

If the gains from both the experimental and 
control group in the key words were subtracted 
from the mean gains achieved in the whole test, 
then the control group would have a mean gainof 
4, 96 while the experimental group would have а 
mean gain of 12.50. These data show that the 
gains achieved by the experimental groups were 
not gained primarily from the showing of films 
and projected still pictures. Stated in another 
way, the gains achieved by the experime ntal 
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group were acquired from the total instructional 
program rather than from the use of films and 
projected stillpictures. Therefore, the gains 
achieved by the experimental group cannot be 
accounted for by the vocabulary included in the 
films and projected still pictures. 


Is There a Relationship Between the I.Q. andthe 
Child’s Gains in the Vocabulary Tests inthe Ex- 


perimental Group? 


The Pearson-Product-Moment Testfor corre- 
lation was found between the child's I. Q. score 
and the gains he achieved in the vocabulary tests. 
The vocabulary test gains were derived by sub- 
tracting the pre-test score from the final test 
Score. In each of the units of study, the corre- 
lations obtained are shown in Table IV. 

In the units of study on Astronomy, Rocks, 
and Air, there is no relationship while inthe re- 
maining units of study, Electricity, Sound, and 
Soil, there is a slight relationship between I.Q. 
Scores and gains achieved in the vocabulary tests. 
In conclusion, no definite relationship exists as 
to 1.9. scores and gains achieved in the voca b u- 
lary tests in any of the units of study on the fifth, 
sixth, and seventh grades. Тһе foregoing con- 
clusion also means that the bright, average and 
slow child profited somewhat the same in this 
study, or stated in another way, the gains 
achieved in the vocabulary tests do not nec- 
essarily depend upon the intellectual level ofthe 
individual. 


Is There a Relationship Between the Standard- 
ized Reading Vocabulary Scores and the Gains 
Achieved in the Vocabulary Tests by the Exper- 
imental Groups ? 


To answer this question, the Pearson-Product- 
Moment Test of Correlation was obtained be- 
tween the standardized reading scores and the 
gains achieved in the vocabulary tests in this 


study. 
The data shows that in only two units of study 


(Rocks and Air) there is a definite correlation 
which exists between standardized reading vocab- 
шагу scores and the vocabulary test scores in 
this study. In the remaining four units of study 
there is only a slight relationship. 

Pupil and Teacher Reactions to Audio-Visual 
Materials. The reactions of pupils and teachers 
represent the subjective evaluation of the us e of 
various audio-visual materials in the classroom. 
A11 of the teachers in the study point outthe in- 
trinsic value of the use of audio-visual materials 
in making for a more effective teaching-learning 
situation. The following excerpts from the teach- 
er's written reactions emphasizes this point: 


«Audio-Visual devices are necessary ex^ 
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periences for the children in order to 
gain the fullest appreciation of the 
concepts presented in any given unit of 
study." 


**,...greater enthusiasm for extensive 
and intensive study by the pupils. ” 


**,...projective aids developed a great- 
er interest and better understanding. °° 


**,...more voluntary suggestions for ad- 
ditional activities were forthcoming from 
students in the experimental group. ’’ 


Some of the students’ reactions are as follows: 


“Films are better because things аге 
illustrated.” 


“We learned more because we could see 
what was meant instead of reading about 
it or hearing it alone, '' 


**Astronomy filmstrips are more inter- 
esting. They help me to get a better 
idea of what the book said. ” 


“ТІ never forget how the layers of earth 
folded over, I just couldn't understa nd 
that when we talked about it in class but 
I get it right away from the film." ` 


The reports from both teache i 

1 геро rS and pupils i 
а situation in which a limited number d ux 
visual materials were employed isa negative one 
An enthusiastic learning situation see med to de- 


velop in the classroom si ion i i 
) | Situation in whichse 
audio-visual methods were used. ы 


Conclusions 


1. Ali experimental groups using the i i 
ture films and projected ЖЫП ees Pa a 
large increase in vocabulary gained over vie 
control groups in all of the units of stud й 

2. Re-test scores of the experimental EROR | 
the Rock and Astronomy units of Stud ies 
lower than the final test scores While tan | n 
other units of study for the experimenta] vis 
and for all the units of the controigrou a 
re-test scores were higher than the fi a = 
scores. me was a loss in retentionfor the 
experimen roup in S 
x £roup in only two of the units of 

3. No definite relationship Seems 1 
1.0. scores and gains buie И зни 
lary tests іп any of the units of stud joy 
fifth, sixth, and seventh grades TAS Ме 

4. In only two units of study (Воск ң 
there is a definite correlation which «x. Аш) 

15{5 
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TABLE IV 


CORRELATIONS BETWEEN 1.9. SCORES AND GAINS ACHIEVED 
IN THE VOCABULARY TESTS BY THE EXPERIMENTAL 
GROUPS IN THE SCIENCE UNITS, GRADES 

FIVE, SX, AND SEVEN 


Grade Unit of Study Correlation 
5 Electricity +.38 
5 Rocks -.01 
з 
6 Astronomy -.15 
6 Sound 4.21 
7 Soil +. 33 
7 Air +. 06 
TABLE V 


PEARSON PRODUCT-MOMENT TEST FOR CORRELATION BETWEEN 
READING VOCABULARY SCORES ON STANDARDIZED TESTS, 
AND'GAINS ACHIEVED IN THE VOCABULARY TESTS 
FOR ALL UNITS OF STUDY 


а RR 


Grade Unit of Study Correlation 
5 Electricity +. 18 
5 Rocks 4.54 
6 Astronomy -.21 
8 Sound +. 09 
1 Soil +. 18 
р Air +. 69 


between standardized reading voca bulary 
scores and the vocabulary test scores inthis 
study. In the remaining four units there is 
only a slight relationship. 

5. АП of the teachers in this study point out the 
intrinsic value of the use of audio-visual ma- 
terials in making for a more effective teach- 
ing-learning situation. 

6. The boys and girls participating inthis study 
point out that an instructional program which 
uses many audio-visual materials enhances 


the learning situation. 


Implications 


The implications of the findings of this study 
are presented in relation to the role of the six- 
teen millimeter film and projected pictures in 
Science unit vocabulary learnings in grades five, 
six, and seven. 

The fact that all of the experimental groups in 
grades five, six, and seven using sixteen milli- 
meter films and projected still pictures had a 
large increase in vocabulary learnings as сош- 
pared to the control groups in all of the units of 
study indicates that these materials should be giv- 
en serious consideration ша science program 
aimed at vocabulary growth. It must be repeat- 
ed that the experimental groups were compared 
not with a situation in which meager number of 
audio-visual materials were used, but rather 
with one in which several audio-visual materials 
were used except for the sixteen millimeter 
film and projected still pictures. This suggests 
that the instructional program should not be 
limited to the sixteen millimeter film and pro- 
jected still pictures, but should include a multi- 
ple number of audio-visual materials, i.e., 
blackboards, bulletin boards, charts, mo dels, 
flat pictures, and field trips. Allof these mate- 
rials carefully chosen and properly utilized 
should enhance the teaching-learning situation. 

One of the major objectives in the teaching of 
science is the development of important under- 
standings ог concepts. These concepts are ex- 
pressed through word symbols, thatis, vocabu- 
lary. The ability to interpret word symbols may 
play an essential part in aiding compreh ension 

and understanding of these concepts іп sci ence. 
This study may have important implications for 
the enrichment of the child's basic science соп- 


cepts. 
Teacher 

tion to train рі 

number of audio 


-training institutions have an o bliga- 
rospective teachers in the use ofa 
-visual materials in the instruc- 
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tionalprogram. Too often, beginning teachers 
limit their instructional program to the use of 
one or two audio-visual materials rather than a 
number of them. И teacher-training institutions 
fail to help prospective teachers, then it is the 
responsibility of the school administrator ога 
designated person, such as the audio-visual 
chairman, to assist teachers in learning how to 
use the various audio-visual materials. Learn- 
ing how to operate the various projectors is im- 
portant, but even more important is learning how 
to use these materials in the instructional pro- 
gram. 

A program of instruction which includes a num- 
ber of audio-visual materials demands budgetary 
provisions for their purchase. School board 
members must be enlightened by their superin- 
tendent as to the intrinsic value of using audio- 
visual materials in the instructional program. 
АП staff members should be encouraged through 
salary provisions to attend summer school and 
enroll in audio-visual courses. Arra ngements 
should be made for teachers to attend audio-vis- 
ual institutes or workshops in which a broad a p- 
proach to instructional materials is used. 

The acquisition of vocabulary, one of the im- 
portant skills in reading, is a prerequisite toad- 
equate comprehension and interpretation in read- 
ing. The utilization of audio-visual mate rials 
enhances the acquisition and retention of vocabu- 
lary, and they should be included in the instr uc- 
tional program. 
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RELATION BETWEEN ENROLLMENT OF 
| HIGH SCHOOLS FROM WHICH STUDENTS 
| GRADUATED AND ACADEMIC ACHIEVE- 
| MENT OF AGRICULTURAL STUDENTS, 
A. AND M. COLLEGE OF TEXAS’ 


JOHN R. BERTRAND** 
A. and M. College of Texas 


THE AGRICULTURAL and Mechanical C ol- 
lege of Texas, as a state supported educational 
institution, admits all white male students grad- 
uating with, at least, fifteen acceptable units 
from an accredited secondary school. One re- 
sult of this unselective admission is the enroll- 
ment of a number of students unprepared to do 
college level work.! A higher proportion of 
these unprepared students enroll in agricultural 
curricula than in arts and sciences or in engi- 
neering curricula. Student loss is heavy among 
these unprepared students. Thisarticle reports 
the results of a study of the relation between en- 
rollment of high schools from which students 
graduated, scores on aptitudes andachievement 
tests, and academic achievement of agricultur- 
al students. 


Previous Research 


During the past thirty years, many studies 
have been made on forecasting college achi eve- 
ment. Some of these, with findings much the 
same as for other studies, have been on stu- 
dents of agriculture. High school grades and 
Scores on various psychological tests have been 
the predictive measures used most often and 
grades given by the college teachers nearly al- 
ways have been-the criterion of achievement. 
Scores on achievement tests administeredatthe 
time of college entry have beenusedin only 
a few cases as predictive measures of scholas- 
tic achievement of agricultural students. Pre- 
viously, little attention has been given to inves- 
tigating possible relations between enrollment 
of high schools from which students graduated, 


Scores on aptitude and achievement tests and ac- 
ademic achievement. 


Sources of Information 


The over-all study of which this is apartwas 
concerned with 637 non-transfer students who 
first enrolled as freshmen in agricultural curric- 
ula at the Agricultural and Mechanical College of 
Texas in 1946, 1947 and 1948, when because of 
overcrowded conditions on the main campus ап 
annex was established to care for students dur- 
ing their freshmen year. An additional 195 stu- 
dents, enrolling at the same time, were not stud- 
ied either because of non-compa rability of 
course work or because of lack of essential infor- 
mation. Enrollments of high schools from which 
students graduated were available for 621 of the 
537 students with which most of the over-a 11 
study was concerned. For purposes of analyses, 
five enrollment categories were set upas follows: 
(1) under 150; (2) 150-249; (3) 250-499; (4) 500- 
999; and (5) 1000 and over. 

The measures used were: high School aver- 
age grade, the three scores (quantitative, lingu- 
istic and total) from the A.C. E. Psychological 
Examination (1946 edition), and scores on the Со- 
operative Achievement tests in mechanics of ex- 
pression, reading, mathematics and science. 
The criteria of achievement which were used 
were: grade point ratio? for all courses taken 
in English, in natural sciences, and in ag r icul- 
ture by the end of the second year, andthe grade 
point ratio for the total of all courses taken by 
the end of the second year. К 

In order to determine Ше relationship of en- 


ж Adapted from writer's unpublished Ph.D. thesis, "Relation of Selected Social and Psychological Fac- 
tors to Academic Achievement of Students in the School of Agriculture, Agricultural and Mechanical 


College of Texas," Cornell University, 1950. 


x# Present address: College of Agriculture, University of Nevada, Reno, Nevada. 


1. Та 1950, the A. and М. College of Texas established its Basic Division for the purpose of ро 
close supervision and assistance to all students during their period of transition from high schoo 


to college. 


2. Grade point ratio is determined at the А. and M. College of Texas ty dividing the total hours дог 
which а student has been registered, whether passed or failed, into the total grade points earned. 
For each semester hour of credit which a course carries, the following grade point scale is мы 
Аа 33 Ba 2; С а1; Da 0; and Р a 0. However, for the purpose of this study, a negative 1 was 


signed for grades of Е. 
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TABLE I 


RANGE OF GROSS SCORES, А.С.Е. PSYCHOLOGICAL EXAMIN- 
ATION, LOCAL NORMS* QUARTILE CATEGORIES 


Quartiles Gross Scores 
Lowest Quartile Under 26 
Second Quartile 86 - 100 
Third Quartile 101 - 114 
Highest Quartile 115 and over 


*Unpublished data from the Office of the Registrar. N equals 1126 
entering, non-veteran students from the 1946-47 freshman class 
at the Agricultural and Mechanical College of Texas. 


TABLE II 


DISTRIBUTION OF 621 STUDENTS* BY ENROLLMENT OF HIGH SCHOOLS FROM 
WHICH STUDENTS GRADUATED AND A.C.E. PSYCHOLOGICAL EXAMINA- 
TI ON QUARTILE CATEGORIES** 


Enrollment of 


high schools Total no. In ACE In ACE In ACE In ACE 
from which stu- of lowest second third highest 
dents graduated Students quartile quartile quartile quartile 
Number of Students 
Under 150 154 87 43 17 7 
150 - 249 133 64 35 17 17 
250 - 499 159 74 30 35 20 
500 - 999 60 22 17 16 5 
1000 and over 115 28 41 32 14 
Total 621 275 166 117 63 
% of 
total Percent of total in each enrollment group 
Under 150 24.80 56.49 27.92 11.04 4.55 
150 - 249 21.42 48.12 26.32 12.78 12. 78 
250 - 499 25. 60 46.54 18.87 22.01 12. 58 
500 - 999 9. 66 36. 67 28.33 26. 67 8.33 
18. 52 24. 35 35. 65 27.83 12.17 


1000 and over 
Total 100. 00 44.28 26.73 18.84 10.15 


ж Enrollment of high schools was unknown for 16 of Ше 637 students with Which most 


is study is concerned. : 
ТЕ атан Curricula, А. and M. College of Texas, 1946-48 entering Classes at 


Annex. 
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rollment of high schools from which students 
graduated to achievement, when the effect of ap- 
titude is controlled, much of the analyses have 
been accomplished with tables which controlled 
the effects of aptitude as measured by gross 
Scores on the A. C. E. Psychological Exam ina- 
tion. Quartile categories based upon local 
norms (Table I) have been the means for con- 
trolling this score for purposes of comparisons. 


Findings 


Students graduating from high schools with 
enrollments of under 150 constituted 24. 30 рег- 
cent of the total (Та е П). Over one-half, 56.49 
percent, of the students from this category 
ranked in the lowest quartile on the A. C. E. Psy- 
chological Examination while a totalof84.41 per- 
cent ranked in the lowest and in the second quar- 
tiles combined. Only 4.55 percent of the stu- 
dents ranked in the upper quartile. Students 
graduating from the large high schools with en- 
rollments of 1000 students or over were 18. 52 
percent of the total. About one-fourth, 24. 35 
percent, of students in this category ranked in 
the lowest quartile. In the highest quartile were 
12.17 percent of the students in this large school 
category. Forty percent of the students from 
this large school category ranked in the com- 
bined third and highest aptitude quartiles. It 
may thus be seen that for the students inthis 
Study, enrollment of high school was direc tly 
related to aptitude scores as measured by the 
A.C.E. Psychological Examination. 

The above generalization was further veri- 
fied by the mean scores on the A. C. E. Psycho- 
logical Examination (Table Ш). Students from 
the small high schools had a mean gross score 
of 82.49. There was an increase in the apti- 
tude gross score with each increase in size of 
high school. The highest average gross score 
for Ше group was 95.21. These Students had 
graduated from the large high schools with en- 
rollments of 1000 and over. А Study of the high 
‘school average grade presented in the same table 
reveals that the highest average grades in high 
School Were earned by students graduating from 
Small high schools. Тһе average grade for stu- 
dents who graduated from high schools with en- 
rollments of under 150 was 83.81. Students 
from schools with enrollments of 150 to 249, in- 


most greatly influenced by their poor showing 
on the linguistic portion of the A. C. E. Psycho- 
logical Examination. The mean L-score for 
students graduating from schools with enroll- 
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ments of under 150 was 45. 92 as compared with 
a mean of 52. 55 for students from the next cate- 
gory and of 57. 40 for students from the large 
high schools. The range in scores was not near- 
ly so great on the Q-score portion of this exam- 
ination as for the mean L-score. 

A comparison of mean scores on achievement 
tests, taken at the time of students’ entry into 
college, with enrollments of the high schools 
Írom which they graduated is significant in this 
study. Achievement scores for mechanics of ex- 
pression (Table IV) had little relationship to en- 
rollment of high school when the effect of the A. 
C.E. Psychological Examination gross score was 
controlled by aptitude categories. It canbeclear- 
ly seen that students ranking in the thirdandhigh- 
est quartiles and who were from the small high 
Schools had a larger mean achievement score in 
mechanics of expression. At Ше same time itis 
to be remembered that a much smaller percent- 
age of students from the small schools were in 
these'two higher quartile categories. 

In the case of reading achievement (Table IV), 
again there seemed to be little relationship be- 
tween mean scores and enrollmentof high schools 
when aptitude was controlled. Students from the 
two smaller school groupings, who also ranked 
in the highestapptitude quartile, hada higher mean 
achievement score in reading than students who 
graduated from the large schools. It should be 
pointed out again that a much smaller percent of 
students from these small schools ranked in the 
highest aptitude quartile. 

Achievement scores in mathematics and sci- 
ence at the time of students’ entry into college 
also had little relationship, when aptitude was 
controlled, to the enrollment of high schools from 
which students graduated (Table IV). 

Mean grade point ratios for all courses taken 
by the end of the second year appeared іо be more 
directly related to aptitude than to enrollments of 
high schools from which students graduated (Ta- 
ble V). Students in the lowest aptitude quartile 
and from the small high schools, however, had 
a higher mean grade point ratio in all cour ses 
taken than did students from the large high 
schools who were in the lowest aptitude quartile. 
With fewer students in the highest quartile cate- 
gory, the significance of their mean grade point 
ratios was less than that of the grade point ra- 
tios of those in the lowest quartile. However, 
the enrollment of the high schools had little ap- 
parent uniform relationship to mean grade point 
ratios. : 

Mean grade point ratios for allcourses in Eng- 
lish taken by the end of the students’ second year 
in college (Table V) were also more closely re- 
lated to aptitude than to size of high schools as 
measured by enrollment. In both the lowestand 
the second quartiles on aptitude, students from 
small high schools had slightly higher ratios than 
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TABLE III = 


HIGH SCHOOL AVERAGE GRADE AND MEAN SCORES ON А.С.Е. PSY- 
CHOLOGICAL EXAMINATION FOR 621 STUDENTS BY ENROLLMENT 
OF HIGH SCHOOLS FROM WHICH STUDENTS GRADUATED* 


Mean scores on 


m High A.C. E. Psychological Examination 
from whichstu- school Gross 
dentsgraduated av. grade Score L-score Q-score 
Under 150 83.81 82.49 48.92 33.52 
150 - 249 82.44 87.50 52.85 34.58 
250 - 499 81.43 89.53 52. 54 37.13 
500 - 999 81. 23 90. 48 54.45 36. 08 
1000 апа оуег 81.50 ` 95.21 57. 40 37.72 ^ 
Total 82.23 88.49 52. 79 35.70 


*Agricultural Curricula, А. and М. College of Texas, 1946-48 enter- 
ing classes at Annex. 
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TABLE IV 


MEAN SCORES ON COOPERATIVE ACHIEVEMENT TESTS FOR 621 STU- 
DENTS* BY ENROLLMENT OF HIGH SCHOOLS FROM WHICH ST.U- 
DENTS GRADUATED AND A.C. E. PSYCHOLOGICAL EXAM- 
INATION QUARTILE CATEGORIES** 


Mean scores on cooperative achievement tests 


Enrollmentof 
high schools For ACE For ACE For ACE For ACE 
from whichstu- lowest second third highest 
dents graduated quartile quartile quartile quartile 
Mechanics of Expression 
Under 150 40.71 46.79 54.29 56. 86 
150 - 249 40.05 48.63 49.00 53. 59 
250 - 499 41.51 46.37 51.06 55.55 
500 - 999 40.45 45.53 51.00 54.00 
1000 and over 38.71 45.41 50. 72 55.50 
. Reading* 
Under 150 45.80 49.83 53. 83 66.00 
150 - 249 47.25 50.31 55.20 65.10 
250 - 499 45.61 51.50 54. 64 61.08 
500 - 999 45.47 50.80 54.82 64.25 
1000 and over 47.70 51.68 56.33 60. 30 
Mathematics 
Under 150 50.05 54.51 58.47 59.57 
150 - 249 49.84 55.63 55.24 61.41 
250 - 499 50.36 55.17 58.20 60.65 
500 - 999 49.95 53.18 56.56 60.40 
1000 апа оуег 51.39 56.15 59.00 62.43 
ӛсіепсе 
Under 150 51.43 54.72 54.41 60. 57 
150 - 249 50.70 55.51 55.00 60.71 
250 - 499 50.88 55.77 58.14 59. 25 
в 500 - 999 53. 68 55.53 57. 31 61. 60 
1000 апа оуег 51. 64 56. 37 59. 13 59.50 


* Scores on Ше reading achievement test were available for only 485 
of these Students. 

**Agricultural Curricula, A. and M. College of Texas, 1946-48 Enter- 
ing classes at Annex. 
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did students from the large high schools. Stu- 
dents in the lowest quartile category from high 
Schools with enrollments of under 150 hada mean 
grade point ratio of 0.06 as compared with а ra- 
tio of -0. 29 for students from high schools with 
enroliments of 1000 and over. Students in the 
Second quartile category from the small schools 
had a mean grade point ratio of 0.83 as com- 
pared with a ratio of 0.41 for students graduat- 
ing from the large high schools. Mean grade 
point ratios for students in the highest quartile | 
category had little uniform relationship to enroli- 
ment of high schools from which students gradu- 
ated. | 

Mean grade point ratios in all natural science 
courses taken by the end of the students’ second 
year in college were more closely related toap- 
titude than to enrollment of high schools f rom 
which students graduated (Table V). Howeve £, 
students in the lowest aptitude quartile from the 
small schools had a mean grade point ratio of 
0.18 which was .48 points higher than the -0. 30 
grade point ratio for students from high schools 
with enrollments of 1000 and over. In the sec- 
ond aptitude quartile there also appears to have 
been a reasonably clear negative relationship 
between size of schools and mean grade point 
ratios. For the third and for the highest apti- 
tude quartiles there was no clear-cut relation- 
ship between enrollment of high schools and 
mean grade point ratios. 

For the first three aptitude quartiles a nega- 
tive relationship was apparent between enroll- 
ment of high schools and mean grade point ra- 
tios in all agricultural courses taken by the end 
of the second year. For students in the lowest 
quartile who graduated from high schools with 
enrollments of less than 150, the mean grade 
point ratio was 1. 17, while students in the same 
quartile who graduated from the large high 
schools of 1000 or more enrollment hada grade 
point ratio of 0.47. Not so clear a trend was 
seen in the second and third quartiles, butsome 
of the same relationship was present. In the 
highest quartile no relationship was evident be- 
tween enrollment of high schools and mean grade 
point ratios in agricultural courses. There was 
a clearer relationship existing between акча 
scores and mean grade point ratios in agric = - 
tural courses than between sizes о high schools 

e point ratios. 
" completion of the second year 
in college was used as a measure аши 
'cess and compared with size оѓ high schoo S; 
nithan controlling the effects of ша ва 
seen Ша! 62. 26 percent of cee Eu eS 
й і 5 
ium sized schools with enro acm Table YI 
i ively, were successful (Ta 
499, Mere rate of completion was by stu- 
The nex. ШН from the large high schools with 
dents айаны мн over. While these were 
enrollments of 1000 or : 
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the two highest rates of compietion, there was 
no clear-cut relationship trend between high 

school enrollments and completion of the second 
year of college study. 

When the effect of aptitude was c ontrolled, 
there still appeared to be no consistent trend 
which would make it possible to use size of high 
schoolas a basis for predicting scholastic 
survival in college. As has already been shown, 
enroliments of high schoois from which students 
graduated were related to scores onthe A.C.E. 
Psychological Examination. Aptitude scores have 
also been shown to be related to academic a- 
chievement. Only in this мау was there a clear- 
cut relationship between size of high school and 
academic success as measured by completion of 
second year in college. Students in the lowest 
aptitude quartile had a second year completion 
rate of 42.91 percent, while 74, 60 percent of the 
students ranking in the highest quartile complet- 
ed the second year. 

Completion of the second. year is a quantita- 
tive measure of academic achievement. By add- 
ing the qualitative measure of mean grade point 
ratios at the end of the second year for all stu- 
dents completing the second year, the two meas- 
ures become more meaningful (Table VII). Be- 
cause of the small number of Students inthe high- 
est quartile coming from high schools with enroll- 
ment categories of under 150 and of 500 to 999, 
inclusively, the mean grade point ratios sho wn 
in Table VII for these two categories p robably 
have little true meaning. 

Students in the lowest aptitude quartile who 
graduated from high schools with enrollments of 
under 150 had a mean grade point ratio in all 
Courses taken by the end of the Second year of 
1.17 while those from Schools with enrollments 
of 1000 and over had a mean grade point ratio of 
0.74. Except for Students ranking in the lowest 
aptitude quartile, there was little consistent ге- 
lationship apparent between size of high schoo] 
and mean grade point ratios. However, within 
each category for size of high school, there was 
a direct relationship between aptitude qua rtile 
categories and mean grade point ratios in 
all courses taken at the end of two years, 


lation- 


ship within each size of high schoo) Category be 


with less than 150 enrollment апа who ranked j 
in 


were relatively less 
n all Courses take n 


or in all agricultura] 


successful in English than i 
in natural science courses 
courses. 
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TABLE V 


ы MEAN GRADE POINT RATIOS АТ END OF SECOND YEAR FOR 621 
STUDENTS BY ENROLLMENT OF HIGH SCHOOLS FROM WHICH 
STUDENTS GRADUATED, AND A.C. E. PSYCHOLOGICAL EX- 
AMINATION QUARTILE CATEGORIES * 


Mean grade point ratios at end of second year 


| Enrollmentof 
Й є high schools For ACE For ACE For ACE For ACE 
ú . from whichstu- lowest second third highest 
|| dents graduated quartile quartile quartile quartile 
1 | а In all courses taken 
| Under 150 0. 47 0. 94 1551 1.20 
|| 150 - 249 0.35 0.88 1.05 1.59 
H 250 - 499 0.35 0.94 1.33 1.33 
500 - 999 0.27 0.88 1. 85 1.38 
1000 and over 0.10 0.77 1.20 1.58 
1 а 
i In English courses 
il Under 150 0. 06 0. 83 1.28 1.29 
150 - 249 0. 08 0. 79 0.79 1.21 
| 250 - 499 -0.02 0.41 0.75 1.25 
h 500 - 999 0.01 0.35 1.24 0.98 
й T 1000 and over -0.29 0.41 0.85 1.45 
Е 
А, In Natural Science courses 
\ . Under 150 0.18 0.72 1.29 1.24 
| 150 - 249 0.01 0. 51 0.57 1.45 
| 250 - 499 -0.08 0.64 0.97 1.05 5 
| 500 - 999 -0.12 0.36 1.01 0.92 
1000 and over -0.30 0.53 0.87 1.40 
aM 
In Agricultural courses 
Under 150 T. PT 1.57 2.02 1.83 
150 - 249 0.82 1.32 1.50 1.81 
250 - 499 0.97 1.45 1.62 1.50 
_ 500 - 999 0. 66 1.51 1.61 1.67 
Ё 1000 апа оуег 0.47 1.23 1.53 1.89 


| "Agricultural Curricula, A. and M. College of Texas, 1946-48 Enter- 
і ing classes at Annex. 
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DISTRIBUTION OF 352 STUDENTS* COMPLETING SECOND YEAR BY ENROLL- 
MENT OF HIGH SCHOOLS FROM WHICH STUDENTS GRADUATED, AND BY 


TABLE VI 


A.C.E. PSYCHOLOGICAL EXAMINATION QUARTILE CATEGORIES** 


Enrollment of 


high schools In ACE In ACE I 
from whichstu- Total lowest second pg В = 
dents graduated No. quartile quartile quartile acida 
Number completing second year 
Under 150 83 38 27 14 
150 - 249 70 26 20 10 B. 
250 - 499 99 32 24 27 16 
500 - 999 31 11 7 п 2 
1000 апа оуег 69 11 26 21 11 
Total 352 118 104 83 47 
Percent completing second year 
Under 150 53. 90 43. 68 62.79 82. 35 
- ы 57.14 
150 - 249 52.63 40. 63 57.14 58. 82 82. 35 
250 - 499 62.26 43.24 80.00 77.14 80.00 
500 - 999 51.67 50.00 41.18 68.75 40.00 
1000 апа оуег 60. 00 39. 29 63.41 65. 63 78.57 
Total 56. 68 42.91 62.65 70.94 74.60 


ж Enrollmentof high schools was unknown for 9 out of the total of 361 students 


completing the second year. 
cula, A. and M. College of Texas, 1946-48 entering 


**Agricultural Curri 
classes at Annex. 
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TABLE VII 


|< MEAN GRADE POINT RATIOS FOR 352 STUDENTS COMPLETING SEC- 

| OND YEAR BY ENROLLMENT OF HIGH SCHOOLS FROM WHICH 

STUDENTS GRADUATED AND BY A. C. E. PSYCHOLOGICAL 
EXAMINATION QUARTILE CATEGORIES* 


Mean grade point ratios at end of second year 


Enrollmentof 
Р high schools For ACE For ACE For ACE For ACE 
from whichstu- lowest second third highest 
dentsgraduated quartile quartile quartile quartile 
Е In all courses taken 
Under 150 T. Br 1.30 1.67 0.95 
150 - 249 1.08 1.37 1.41 1.68 
250 - 499 1.01 1.18 1.51 1.43 
500 - 999 0.87 1.63 1.57 0.99 
1000 and over 0.74 1.14 1.57 1.64 


In English courses 


Under 150 0.39 0.95 1.32 0.95 
150 - 249 0.68 0.99 1.07 1.29 
250 - 499 0.52 0.52 0.87 1.24 
500 - 999 0.40 1:21 1.25 0. 32 
š 1000 апа оуег 0.03 0. 65 1.07 1.48 
ы Іп Natural Science courses 
Under 150 0.85 0. 97 1.44 1.21 
150 - 249 0.68 1.02 0.90 1.44 
250 - 499 0.65 0.81 1.15 1.17 
500 - 999 0.61 1.48 1.41 0.54 
1000 апа оуег 0.18 0.80 1.23 1.36 
? 
In Agricultural courses 
Under 150 1.61 1. 64 2.02 1. 78 
| 150 - 249 1.42 f." 1.67 1.91 
| 250 - 499 1.55 1.50 1.74 1.58 
РУ 500 - 999 1.22 1.97 1.78 1. 35 
L À 1000 апа оуег 1.06 1.49 1.76 1.94 
j 


"Agricultural Curricula, A. and M. College of Texas, 1946-48 enter- 
ing classes at Annex. 
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Mean grade point ratios in all natural sci- 
ence courses taken by students completing the 
second year had little consistent relationship 
with size of high schools from which students 
graduated (Table уп), butthese ratios appeared 
to be directly related to aptitude quartile cate- 
gories within each grouping for enrollment of 
high schools. 

For students completing the second year, 
little consistent relationship was found between 
either size of high schools or aptitude quartile 
categories and mean grade point ratios inallag- 
ricultural courses taken during the two years. 


Summary 


Three points stand out in all the tables which 
have been presented to show the qualitative re- 
lationship to enrollment of high schools from 
which students graduated. With the exc eption 
of mean grade point ratios in English, the high- 
est grade point ratios made by students in the 
lowest aptitude quartile were made by students 
from small high schools with enrollments of un- 
der 150 students. With no exceptions, the low- 
est mean grade point ratios shown by any cate- 
gory were made by students in the lowest quar- 
tile from the large schools of 1000 or more en- 
rollment. With few exceptions, the highest 
mean grade point ratios for any category were 
earned by students in the highest quartile who 
were from the large schools of 1000andover 
enrollment. 
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CHILDREN'S THINKING IN THE PROCESS 
OF SUBTRACTION’ 


E. GLENADINE GIBB** 
Iowa State Teachers College 
Cedar Falls, Iowa 


Purpose and Background 


THE PURPOSE of this study was to analyze 
Children's thoughts in solving mathematical 
problems involving the process of subtraction. 
More Specifically, this investigation was un der- 
taken to study children's thinking during the 
‘intervening interval’’ between the time theyare 
asked to solve a problem and that time when they 
present a solution in an effort to understand the 
way in which children perceive applications of 
the process of subtraction as the degree of ab- 
straction in the context of the number situation 
varies. 

In the past two decades such research stud- 
ies as made by McConnell (12), Thiele (21), and 
Swenson (20) on comparative methods of teach- 
ing found that a “meaning theory” of instruction 
yielded superior learning results. This theory, 
so named primarily from the fact that children 
“shall see sense” in what they learn (1) empha- 
sizes methods of instruction which lead children 
to discover relationships and observe generali- 
zations. Present theories of the teaching of 


their applications. 

Judd (9) has described two ways іп whicha 
Student may acquire a knowledge of what a pro- 
cess really means: (a) he may be given many 
Situations in which the process is used and bya 
“gradual Process of abstraction and generaliza- 
tion arrive at an understanding of the process," 


Child has been urged and per- 
pelled by his elders to learn 


* А summary 


The writer wishes 
direction the study 
was designed, for the as 


,9f an unpublished dissertation submitted 
sity of Wisconsin in partial fulfillment of the req 


rapidly and without regard for his native inter- 
ests a system of numbers consisting of abstract 
ideas. Little is known regarding the effect of 
this emphasis on **products of learning" upon 
the most efficient utilization of a child's capacity 
to learn. However, if a child is to be guided ef- 
fectively in the development of mathematical con- 
Cepts, then it seems necessary not only to ana- 
lyze the number system but also to carefully con- 
Sider children’s ways of thinking. у 

The importance of this two-fold consideration 
in the process of subtraction was treated by Judd 
(9). More recently, it has been noted by Swen- 
son (19) in a consideration of instructional pro- 
cedures in arithmetic for primary grade children 
and more specifically, by Van Engen (22) and Наг- 
tung and others (5) in formulating a method of in- 
struction in this area. 

From an evolution of a number system to de- 
scribe the numerosity of objects, a concept of a 
number system has been developed apart from 
the context of collections of distinct objects. This 
abstract form has become independent of objects 
to be counted. Thus, if ag_, is the unique solu- 
tion of the equation x + a, = ag, then ag-, is the 
difference between аз and a,, Or аз-, = ag - a,. 
This process of finding as-, when ag and a, are 
given is defined as subtraction. When numbers 
of a system are associated in one-to-one corre- 
Spondence with distinct groups of objects, as А, 
Аз, and Аз-, respectively, subtraction becomes 
the process of finding the number associated with 
the difference of two groups, Ас and A,. Or it 
may be said to be the process of finding the other 
group, which when combined with А, will give 
As. In identifying applications in situations fa - 
miliar to children, one can show that theyareall 
solved by the same mathematical process and 
that they are mathematically equivalent. 

Studies in concept formation as made by 
Piaget (16,17), Long and Welch (10, 11, 23, 24), 
Heidbreder (6,7) indicate that meaning is, at 
least in part, a function of experience. The lim- 
ited range of children’s experiences with mathe- 
matical concepts in contrast to those of adults 
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suggests that children's perception of quantita- 
tive situations might be much different from 
that of adults. Children, therefore, may not 
perceive the mathematical identity inv varying 
applications of the process of subtraction. 

Thus, in the classroom if the teacher is pro- 
viding experiences in subtraction as she con- 
ceives of the concept and if a child is try- 
ing to understand the situation with a different 
concept of the process to be used, then it may 
well be expected that these conflicting ideas will 
cause the child to become confused. In a broad- 
er sense, if mathematical concepts and their 
applications are developed in the classrooms 
from the concepts of adults, and if children 
bring to those same situations immatureandpos- 
sibly different concepts, then it may well be ех- 
pected that a chaotic learning experience willre- 
sult. 


Statement of the Problem 


This investigation was an effort to determine 
whether or not three problem situations to which 
the process of subtraction is applicable elicit 
different responses from children in selected 
Second grades. 

In this study thinking has been regarded аз 
the mental activity a subject uses in recognizing 
relationships among properties of objects and 
symbols. This mental activity was observed in- 
directly through responses given by children in 
relating their manner of solving selected prob- 
lems where the process of subtraction and the 
context of the problem were systematically var- 
ied. 

Three applications to which the process of 
subtraction is applicable were defined as: 
(1) take-away subtraction situations, which pre- 
sented the subject with a group from which a 
part was to be taken; (2) additive-subtrac- 
tion situations, which presented the subject with 

a part of a desired group to which another part 
must be added that the group might be obtained; 
and (3) comparative-subtraction situations, 
which presented the subject with two groups for 
which the difference in the numerosity of the 
groups was to be determined. | 
The contexts, in which these applications 
were presented, were defined as three levels of 
abstraction—concrete, semi-concrete, and ab- 
stract—as commonly considered in the teaching 
of mathematics. (1) At the concrete level, the 
problem was presented in a context of smalltoys 
and other manipulative objects. (2) At the semi- 
concrete level, the problem was presented in a 
context of groups of circles a nd/or squares 
mounted on cards. (3) At the abstract level, 
the problem was presented in a context of 1ап- 
age and number symbols. 
а rà this investigation children's thinking dur- 
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ing the ‘‘intervening interval" between the tim e 
they were asked to solve a problem andthattime 
when they presented a solution was studied in an 
effort to understand the way in which ch ildren 
perceive applications of the process of s ubtrac- 
tion. In addition, the degree of abstraction in the 
context of the number situation was variedintest- 
ing the following null hypothesis: 


For young children, certain applications 
of subtraction do not present situations in 
which children respond differently. 


The principal questions which this study has 
attempted to answer are: 


1. Do these three applications of subtraction pre- 
Sent situations in which young children re- 
Spond differently? If so, in what ways are 
these differences evident? 

2. Do the contexts in which the applications are 
presented influence the children's responses 
to the problems? If so, in what ways are 
these influences evident? 

3. Is one kind of context more appropriate for an 
application than another context? If so, in 
what way is one more appropriate than an- 
other? 


Since this was an exploratory Study, no effort 
was made to control experience. Rather, this in- 
vestigation has attempted to analyze mental pro- 
cesses of a group of randomly selected second 
grade children in their Solutions of problems in 
the categories as defined above. 


Design of the Investigation 
-- 6 E vestigation 


2 The Problems— For each of the nine com bina- 
tions of application and abstraction, nine number 
pairs were used in describing quantitative situa- 
tions familiar to children. These number pairs 
Were selected at random from those subtraction 
facts whose minuends are less than ten and whose 
differences are more than one. That the nine 
problems for each combination might appear 
more than once in the investigation, each of the 
eighty-one problems appeared four times, thus 
making thirty-six problems for each type of situ- 
ation or three hundred twenty-four problems in 
the investigation. 

Small toys and other manipulative objects 
(blocks, marbles, pennies, nickels, jacks, balls, 
pencils, cards, cars, trucks, trains, balloons 
whistles, paint brushes, and paints) were used ' 
in the concrete context. At the semi-conc rete 
level, each group was pictured by darkgreenpa- 
per circles or squares mounted in à linear ar- 
rangement on 5 X 8 white cards. For the abstract 
context, problems were written about the same 
descriptive materials with each of the number 
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pairs as used at the object level. These prob- 
lems were typewritten (primer type) on 5x 8 
white cards. 

Although the nine number pairs appeared in 
the same order for each child, no child had the 
same sequence of types of problems, andíorno 
child did any like application appear in two con- 
texts consecutively. 

The Children— Since each child was to work 
a problem in each of the nine combinations of 
application and abstraction, thirty-six children 
were selected from second grades in twenty- 
four graded schools (two or more teachers) 10- 
cated in East and West Districts, Dane County, 
Wisconsin. One to three children were random- 
ly selected from each school. 

These children ranged in intellectual ability 
from intelligence quotients of 83 to that of 162, 
according to scores on intelligence tests given 
in the respective schools. Тһе mean of intelli- 
gence quotient scores for the group was approx- 
imately 114. As indicated by the occupations of 
the fathers, these children came from homes 
representing varying levels of socio-economic 
Status. From the information given by the teach- 
er regarding the child's background of exper- 
ience and success in arithmetic, it was noted 
that all thirty-six children had been taught the 
take-away method of subtraction. Furthermore, 
all had at least limited experience at the timeof 
the interview with the applications of subtrac- 
tion used in this study. The kind and amount of 
number experiences varied considerably. 

The Interview— The writer, who conducted 
all interviews, and the subject were provided a 
room where they might work without inter r up- 
tion. Before the nine problems were presented, 
Several problems were given to clarify any ques- 
tions the child might have concerning the relat- 
ing of the processes he used in solving the prob- 
lems. All problems were presented verbally, 
as the respective contexts were placed before 
the child. Following the giving of his ans wer, 
the child was asked to tell how he arrivedathis 
Solution. 

All interviews were recorded on tape and 
P supplemented at the time of the interview 

y notes taken of observed behavior of the child 
while he worked. It was from these recorded 
interviews that an analysis was made of chil- 


dren’s responses t i 
lems. о these nine types of prob- 


Scoring Procedures and Statistical Techniques 


In making an analysis of the recorded inter- 


views, Six variables, were defined in the follow- 
ing manner: 


Process was the manner of solving the problem 
with reference to the level of mathematical 


13 


procedure used to arrive at a solution (i.e., 
from simple forms of counting to the use of 
number facts). 

Understanding was the degree to which the idea 

— of the problem was recognized. 

Equation was Ше level of development of the sub- 
traction equation as-, = аз - 2, inthe pro- 
cess of solving the problem. | 

Solution was Ше adequacy of the response given 
in answer to the question asked regarding the 
problem situation. 

Time was the length of the period from the con- 
clusion of the verbal presentation to the giv- 
ing of the solution to the problem. | 

Verbalization was Ше number of words used in 
response to the question, “Нож did you find 
ош?” 


Rules were formulated for assigning a num- 
ber to a level of difficulty of the property consid- 
ered. A measurement for each property on each 
of the three hundred twenty-four problems was 
thus given. Three persons were asked to 
serve as judges in scoring fifty interviews ran- 
domly selected from the three hundred twenty- 
four interviews. These judges were in agree- 
ment on approximately seventy-five percent of 
the scores with those given by the writer and at 
least two judges were in agreement on about 
ninety-one percent of Ше scores. The wr iter 
re-scored this same sample and was inninety- 
nine percent agreement with the original scores 
she had given. 

The present investigation was SO designed that 
an application of the technique of the analysis of 
variance might be used in testing the hypothesis. 
The mathematical model appropriate for this an- 
alysis was one in which both systematic and ran- 
dom variation are considered since applications, 
contexts, and variables for scoring were sources 
of systematic variation and variation assignable 
to children a source of random variation. Thus 
the mixed model was used in the analysis of the 
composite score (sum of five variables, кош 
ing verbalization). For Ше analysis of each 0 
the six variables the simple linear regre ssion 
model was used. A 3x 3 x 36 randomized block 
design with one observation per cell was usedfor 
each of these analyses. Where each of the fi ve 
variables were regarded as а fourth dimension, 
a four-factor analysis was made. : 

Since there was only one observation per cell, 
there was no estimate of error from within cells. 
Thus, the three-factor interac tion sum of 
squares was used in its place. Where only an 
overall analysis of variation contributed by the 
components was made, main effects and inter- 
action effects were tested against the sec ond- 
order interaction effect in the three-factor anal- 
ysis, and agains t the third-order interaction 
effect in the four-factor analysis. Models used 
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in the estimation of components of variance are 
found in papers by Johnson and Keeping (8), 
Crump (2), Daniels (3), and Satterthwaite (18). 
However, the particular approximate test used 
in this investigation for components of variance 
was that described by Mood (13). Тһе sum of 
squares for the triple interactions, as well as 
for the third-order interaction was found by di- 
rect calculation as described by Edwards (4). 

In АП analyses the one percent level of signif- 
icance was used for the rejection of the hypothe- 
sis involved. 


Analysis of Results 


Analyses were made of the variation (а) ac- 
cording to a composite score, a linear combina- 
tion of five scores taken from the interviews— 
namely, process, understanding, equation, so- 
lution, and time; (b) according to each of the six 
variables considered independently; and (c) ac- 
cording to five variables which were no doubt 
correlated, considered as a group. Standard 
scores were used for analyses in (a) and (c) and 
raw scores were used for analyses in (b). 

In Table I-A the analysis of variance of the 
behavior as represented by a composite score 
of the five variables is given. From this analy- 
sis one observes significant main effects in ap- 
plications, contexts, and individuals (children) 
and in the interaction of individuals with both 
applications and contexts. There was no signif- 
icant interaction between applications and con- 
texts. Іп all cases these hypotheses are state- 
ments in the form of null hypotheses. 

In Table I-B the main effects (applications, 
contexts, individuals) have been compared with 
two-factor interactions rather than with the tri- 
ple interactions as Was done to obtain the results 
in Table I-A. The rationale for the second com- 
parison as given in Table I-B follows. It was 
observed in Table I-A that the null hypothesis 

was rejected for A X I, namely, that applica- 
tions and individuals do not produce effects to- 
gether which are not produced indep e ndently. 
Consequently, if interactions and applications 
were of the same order of magnitude, then one 
could not be assured that there was a difference 
between applications. In consequence, applica- 
tion differences are important if they are large 
relative to applications-individuals interaction. 
Similarly, context and application ==: пс : 5 3 
are important if they are large ueque ни 
action effects. From Table I-B it eum sels 
the application differences are most impo 

i interaction. 
uic analysis of variance for each of 

ariables—process, understanding, equation, 
= time, and verbalization was made. Ta- 
на II presents the analyses of ien = 2. 
of these six variables. Summarizing ше 
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yses, differences do exist among the applica- 
tions and among the contexts for each of the var- 
iables, excluding verbalization. One observes 
no significant interaction between applications 
and contexts for any variable in any analysis. 
However, again excluding verbalization, there is 
significant interaction between applications a nd 
individuals for all variables. Significant inter- 
action between contexts and individuals was pres- 
ent only in the equation used and in the time tak- 
en to arrive at a solution. 

In the four-way design (5 x 3 x 3 x 36) an anal- 
ysis of variance was made of the variables, ap- 
plications, contexts, and individuals (children). 
From this analysis, presented in Table III, one 
observes significant differences among app lica- 
tions, among contexts, and among individuals. 
No significant interaction effects are observed 
between either applications or variables with con- 
texts. However, there are observed significant 
interaction effects between individuals with con- 
texts, applications, and variables, respectively. 
Too, there is significant interaction between ap- 
plications and variables. Only one significant 
triple interaction is observed, that of applications, 
contexts, and individuals. АП other triple inter- 
actions were combined with the interactions of 
variables, individuals, contexts, and applica- 
tions. Main effects and other interactions were 
then tested against this combined group. 

The Findings — For those analyses in which 
the null hypotheses regarding applications and 
contexts were rejected, a comparison was made 
between the three applications and the three con^ 
texts. The findings follow: 


Applications 


1. Composite behavior: Take-away problems ap- 
peared easiest and comparative problems 
most difficult if the degree of difficulty of a 
problem may be said to vary inversely with 
the level of performance, that is, for prob- 
lems less difficult a higher degree of perforn.- 
ance may be expected whileforproblems more 
difficult a lower degree of performance is 
expected. 


2. Understanding: The lack of understanding for 
comparative problems was observed in partic- 
ular during the interviews. For exa mple, 
when a child was presented with eight forks 
and five knives and the question, “Ноу many 
more forks do you see than knives?” the re- 
sponse was commonly, **Eight forks. "' 


3. Equation: Approximately three-fourths of the 
take-away problems were solved by the equa- 
tion, аз-, - as - a, while the remaining опе- 
fourth was almost equally divided between the 
use of the equation of the form a, + ag-, = as 
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and by means of по identifiable equation. 
Three-fourths of the additive problems were 
solved by the addition equation and one-eighth 
of them by the subtraction equation. Approx- 
imately thirty-eight percent of the com pari- 
tive problems were solved by use of the sub- 
traction equation, about thirty percent by the 
addition equation, and twenty-five percent by 
means such that no equation could be ident- 
ified. The remainder of the problems were 
not attempted. 

In eighty-one percent of the take-away 
problems the equation was inferred from 
what was actually done or indicated as neces- 
sary to do (e.g., taking out) in order to solve 
the problem. Similarly, seventy-s e ven per- 
cent of the additive problems and eighty-two 
percent of the comparative problems were 
solved in terms of actively thinking with the 
groups (e.g., putting more on, one-to-one 
correspondence) rather than in terms of the 
mathematical symbols. 


4. Solution: A higher degree of rightness of so- 
lution was given for take-away problems than 
for the other kinds of problems. Most incor- 
rect solutions were given to problems involv- 
ing comparative situations. 


5. Time: Additive problems required a slightly 
longer period of time than comparative p r ob- 
lems but both took a longer period of time 
than did the take-away problems. 


Summary There were significant differences 
among applications for the understanding, equa- 
tion, solution, and time scores. Highestdegree 
of attainment was made in take- away problems 
and lowest level of attainment was made for com- 
parative problems. Additive problems were 
found to take a longer period of time for solution 
and were farthest removed from the generaliza- 
tion of the subtraction process being distinct 
from addition. Thus, for seven-year-old chil- 
dren, types of subtraction problems do not ap- 
pear mathematically or psychologically the same. 


Contexts 


Зрпровие behavior: There was an indication 
weh а ег level о performance for problems 
В. 1. presented with stimuli in the form 
By. es and/or circles mounted on cards. 
€ same measurement there was indica- 


tion that the abstr. 
act contexts 
be the most difficult. were found to 


Understanding: Problems presented with pic- 
stimuli were slightly easier to com pre- 
hend and problems presented without direct 
reference to objects and pictures were most 


TE 


difficult to comprehend. 


3. Equation: For problems presented in an ab- 
stract context, the subtraction equation was 
used approximately twice as often as the ad- 
dition equation. For ninety-five percent of 
the problems presented with objects, the 
child's account of what he did made reference 
to actively taking a group away Or p utting 
more on as the means of solving the problem. 
This was also the situation from some eighty- 
seven percent of the problems presented with 
squares and circles and seventy-three percent 
of problems in abstract contexts. 

Some twenty-five percent of the problems 
classified according to context, were solved 
by means not identifiable in the form of an 
equation. For the remaining problems pre- 
sented in concrete and semi-concrete contexts, 
the equations а, + 8-1 = 4s and as-; = аѕ - 
а), were used approximately the same num- 
ber of times in solving problems in conc r ete 
and semi-concrete contexts. 


4. Solution: The use of object and picture stimu- 
li in presenting problems in this investigation 
was approximately equal in effectiveness for 
bringing about similar degrees of rightness of 
solution. 


5. Time: Of the total time for the solution of all 
problems, forty-three percent was used for 
problems presented with an abstract stimulus 
and fifty-seven percent for the object and pic- 
ture contexts combined. 


Summary— There were significant differences 
among contexts for levels of understanding, 
equation, solution, and time scores. Levels of 
performance for problems presented іп semi- 
concrete contexts were higher than for those pre- 
sented in concrete contexts. However, lowest 
scores were made by responses given to p rob- 
lems presented in abstract contexts. Therefore, 
contexts utilized in this study, semi-concrete 
contexts are less difficult than concre te con- 
texts. Children have less difficulty solving prob- 
lems if they can manipulate objects or at least 
think in presence of objects with which the prob- 
lems are directly associated than when solving 
problems wholly on a verbal basis. 


Individuals 


There were significant differences among in- 
dividuals for all six measurements. Aninformal 
analysis suggested that two factors which maybe 
related to this difference are intelligence and ex- 
perience. No attempt was made to identify the 
relationship or contribution of either to the re- 
sponses given. 
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Interactions 


1. Observing the composite description of each 
response made to each application, in no 
case did all applications evoke the same be- 
havior from the same child. 


2. These findings indicated that children indi- 
vidually pass through sequential stages, or 
levels of the development of the mathemati- 
cal generalization of subtraction. 


3. These children did not respond equally well to 
problems presented in varied contexts, thatis, 
Гог children of this age there is no context in 
which problems appeared the same to all. 


4. For no child were measurements similar for 
allvariables. For the most part, each child 
was unique in the particular combination of 
scores he received for his group of nine re- 
sponses. Thus, one score does not give a 
uniform picture of the child’s behavior in 
problem solving situations. Not only did dif- 
ferent children bring many varied proced- 
ures to problem solving situations, but also 
the same child used many varied procedures. 


5. There were foundno statistically significant 
differences in the interaction of applications 
and contexts. For these children the applica - 
tions and contexts in which the applications 
were presented are independent of each other. 


6. There was significant interaction between ap- 
plications and individuals. Hence, this study 
gave no evidence of a general subtraction 
ability which characterizes children. 


7. There was significant interaction between 
contexts and individuals. Thesechildrendid 
not respond equally well to problems present- 
ed in similar contexts. 


8. There was significant interaction between 
variables and individuals. No score gave a 
uniform picture of the child’s response to the 
problems and for no group of five or more 
children were there similarities among the 
pattern of scores for the different variables. 


9, There was no significant interaction between 
| variables and contexts; that is, the scores 
used were not more adapted to one kind of 


context than to another. 


ienificant interaction between var- 
sa e and'applications. The equation score in- 
di ted that comparative problems were more 
eo 1у conceived as applicable of the process 
clamet than additive problems . This ден 
О аи иа is in support of the first resu 


above. 
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Conclusions 


Within the limitations of this exploratory in- 
vestigation the following conclusions were made. 
The principal conclusion, the one which an- 
swered the question raised by the null hypothesis, 
was that relatively young children with limited 
number experience gave different responses to 
problems involving three of the applications of 
subtraction. They do not as a group conceive that 
one basic idea appears in all applications. Rather, 
they solved the problems in accordance with the 
reality of the problem situation. 
Furthermore, the kinds of materials (objects, 
pictures, words) used in the problem stimuli sug- 
gest different responses. Children were slightly 
more successful in the solutions of problems 
when they were solved in the presence of objects. 
According to the measures used inthis study, 
children more easily comprehended the problems 
and saw the applications in relation to the process 
of subtraction when problems were presented in 
semi-concrete contexts. Problems in either con- 
crete or semi-concrete contexts were less diffi- 
cult than problems presented wholly on a verbal 
basis. For materials of the type used and meas- 
urements employed in this study, children were 
most successful in general overall problem solv- 
ing behavior with those problems presented in 
semi-concrete contexts. 
There was no context which appeared more 
appropriate to one application than to another. 


Suggestions for Further Research 


1. АП results of this investigation may be said fo 
relate to such localities as Dane County, Wis- 
consin, where there exists a similar organiza- 
tion of school systems and the same philosophy 
of education. Findings for other types of local- 
ities are needed to support this study. 


2. Additional evidence obtained from alterations 
of design would be desirable. Тһе lackof rep- 
lication in the design used in this study has 
been recognized. 


3. A longitudinal study, not only of group trends 
but also of case studies would give helpful in- 
formation concerning the evolving of the mathe- 
matical concept of subtraction. 


4. The problem of the effectiveness of certain 
concrete materials in concept development 
seemed to be suggested by this study, raising 
the question as to whether or notcertain kinds 
of materials detract from the basic conceptto 
be developed. 


5. Mathematical and psychological analyses of 
many other mathematical concepts are needed 
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if teachers of mathematics are to understand 
some of the problems that may confront their 
students in the formation of those concepts 
at various levels of deveiopment. 


6. It is recognized that ways of studying chil- 


dren's behavior in problem solving situations 
are crude. Research in that area as well as 
in the measurement of such behavior would 

contribute to the studies of mental processes. 
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AN EXPERIMENTAL STUDY OF CASE- 
DISCUSSION LEARNING 


LEONARD A. OSTLUND 
Kent State University 
Kent, Ohio 


1. The Problem 


THE PURPOSE of this study was to evaluate 
certain goals of the case-discussion method of 
teaching. The content of this type of course 
consists of problems in interpersonal relations 
which occur in the family, college and industry. 
Students are provided withcase-books and read- 
ings and encouraged to participate inclassr oom 
discussion. The teaching technique is largely 
non-directive, and the teacher attemptsto seta 
permissive atmosphere in which each stude nt 
will feel free to participate. 

The stimulus for this type of course was a 
Seminar conducted by Wallace B. Donham, Dean 
of the Harvard Business School. The writer be- 
came intrigued by the Human Relations Course 
while teaching it at Colgate University with Dr. F. 
К. Berrien, Chairman of Human Rela tions and 
author of Comments and Cases on Human Rela- 
tions (5). Asa result of a seminar with Dean 
Donham the writer became further interested. 


Il. History of the Problem 


A survey of the literature reveals that many edu- 
cators andpsychologists have become interested 
inresearch concerning case-discussion teaching. 
Ingeneral, researchhas been in the area of the lec- 
ture-discussion method of teaching vs. case dis- 
cussion teaching. This controversy hasalso been 
couched in terms of curriculum-centered уз. stu- 
dent-centered theory. The writer has contributed 
two research studies of case-discussion classes 
which have raised problems that have beenincor- 
porated in the present study (8), (9). 

A recent Summary by Wispe has integrated 
much material concerning this controversy (12). 
In general, the traditional lecture method of 
teaching has proved useful in mastery of content, 
but apparently non-lecture methods do equally 
well, Concerning favorable changes in attitudes 
and interpersonal skills, non-lecture methods 
often prove Superior to traditional lecture me th- 
ods, The non-lecture method effects cha hges 
of attitudes in the direction of a positive va- 
lence for subject matter andalsotends to im- 
prove interpersonal skills. 


Ш. The Experimental Design 


The experimental and control gro ups were 
rigidly matched according to the following char- 
acteristics: friendship, grade point average, 
class standing, and previous experience in case- 
discussion courses. The S.'s were initially con- 
tacted by means of a questionnaire circulated in 
the classroom with the consent of the teachers. 
On the basis of this information the groups were 
matched and each individual was telephoned by 
the writer. No coercion was used.  TheS.'s 
met in groups of six at the beginning of the term 
and again three months later. After the final 
meeting a general session of all participants 
was held, at which time the students were ас- 
quainted with further details of the project and 
there was a drawing for awards. The соорега- 
tion of the students and faculty throughout the 
study was exemplary. _ 

The experimental S. 5 were drawn from саве 
discussion courses, whereas Ше control 5.75 
were drawn from non-case-discussion co иг 565. 
The experimental S. "5, during Ше рег iod Dem 
tween tests, were having experiences inthe case 
discussion method of instruction, whereas the 
control group was not. Therefore, it would Бе 
appropriate to attribute changes which оссигге 
іп Ше experimental group to case-dis cus sion 
learning, provided these changes didnot oc c ur 
in the non-case-discussionlearning group. Thus 
the control group functions as а constant іга mer 
of reference against which changes in the 24215 
mental group may be evaluated. | Since the con" 
trol group has not had the experience ofthis Spe 
cial educational training, we cannot expect any 

es in their behavior. | 
u^ controlgroup thus provides a base-line ДЕ: 
it were, against which we may evaluate the prog 
ress of the experimentalgroup. Wecan determine _ 
whether they have been able to transfer their case- 
discussionlearning to this new situation. This = 
perimentally created situation was purp ose У 
unstructured so that each S. was provided wit i 
an equal opportunity to demonstrate any genera a 
increase in maturity of approach to the disc us: 
sionand solution of problems in interpersonal re и 
lationships, which had occurred over this three 


* This paper was adapted from a thesis written for the Ph.D. degree at the University of Kansas, Law- 
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mmittee comprised of Professors Fritz Heider, Marston McCluggages Hilden Gi » 
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and the Chairman, Anthony Smith gave generous assistance and my wife expedited every phase of t 


study. 
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month interval. The experimentaldesign used 
in the present experiment has been repr od uced 
in Table I. 

The number of S.'s per group was held con- 
stant at six for each meeting. There were six 
experimental (case-discussion method) groups 
which met for two sessions, one at the beginning 
and one at the end of the semester. Six control 
(non-case-discussion method) groups did like- 
wise. The “айег” sessions occurred three 
months later than the “before” sessions. The 
same S.’s came to the “before” and the “after” 
sessions and the personnel for each group was 
kept the same for both of these meetings. With 
few exceptions which were occasioned by drop- 

outs and refusals, almost all of the seventy-two 
S.'s each came to two, one-hour meetings. 

The Experimental Groups—The experimental 
groups were chosen from four courses taught by 
the case-discussion method: Cases in Human 


Relations, Personnel Management, Cases inMar- 


riage and the Family, and Business Administra- 
tion Practices. The cases used in these courses 
all involve problems of interpersonal rela tions. 
While the teachers differ in regard to age, exper- 
- ience, and classroom technique, these courses 


Spring from à common source—the seminars giv- 
еп at the Harvard Business School by Dean Wal- 


lace B. Donham—and adhere to a commonset of 
underlying principles and methodology. 

There were six groups of experimental S.'s 
and each group met at the beginning and at the 
end of a semester. Each group consistedofsix 
S.'s who were drawn from different sections of 


the same course or from different case- discus- 


Sion method courses, depending uponavailability 
of the S. 's or their suitability in terms of the 
matching criteria. 


The Control Groups—The control group S.'s 


were drawn from classes whose students were 


registered in five different schools of the Univer- 


sity in order to gain an adequate sample of the 


: ^ и 
“average non-case-discussion course student. 


These schools included the College of Liberal 
Arts, the School of Engineering, the School of 
Journalism, the School of Education, and the 


ol of Business. та 
€ was felt that balancing the personnel within 


roup of six non-case-discussion stu- 

зарары лар s them from aset deae 

would prove more representative of та и 

age non-case-discussion student." There ге) 
h control group was arranged so that no mn 

г two members, in each group of six 5.5, 

ere from the same school. Moreover, itis 
| individuals were chosen from differen 

RUE within the school. This arrangement 
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was possible because there was a wide range of 
non-case-discussion courses in each of these 
five schools. 

There were six groups of control S. 'S, and 
each group of the same S.'s met at the beginning 
and at Ше end of a semester. Each group con- 
sisted of six 5. 's who were drawn from differ- 
ent sections of the same course or from differ- 
ent non-case-discussion courses. 

The Number of S.'s Per Group—The choice of 
Six 5.75 per group was not an arbitrary one, 
but was governed by important considera tions. 
Practical considerations involved the fact that 
the size of the group could not be too large, since 
not enough case-discussion courses меге avail- 
able from which S. 's could be drawnsothat the 
S.'s would come from a different s ection or 
Course. Then too, the group could not be too 
large so that E. , working alone, might not be 
able to observe all the interactions. Howeve T. 
if the groups were too Small, the results would 
not be amenable to statistical treatment. Groups 
of six S. 's have been used by Bales (2), Stephan 
(10), and French (6), and have proved satisfa e- 
tory. 

After the experimental procedure had been 
formulated, E. tried it out ina pilot study in 
order to become familiar with the routine andto 
discover whether the methodology would prove 
adequate. Тһе pilot Study proved useful in that 
it demonstrated the adequacy of some proced- 
ures and led to some fruitful modifications. 


IV. The Experimental Procedure 


Barker and Wright have called attention to 
the coerciveness of the behavior setting —the 
place in which behavior takes place (3:17). With 
this principle in mind, E. felt that discussion 
Would be enhanced if it took place in anappropri- 
ate physical setting. Therefore, all me etings 
were held in a room which was regularly used 
for seminars and conferences, 

E. sat at one end of the table, the six 8.5 
sat at the other end, three facing three. This ar- 
rangement has been suggested by Bassand К1и- 
beck (4) and used by many investigators. S.'s 
were given identification numbers from one to 
Six. These were placed on the table in front of 
them. There was no attempt to conceal the mi- 
сгорпопе and recording equipment.* It was ex- 
plained that recording was necessary inorder to 
insure accurate data, Е. kept a record ofallre- 
marks by noting the S.’s number andan identi- 
fying word. Playback of the recordings pe rmit- 
ted each conversation to be traced to its source 
and insured accurate transcription. 


Recorder and a Gray Audograph Disc recorder were used and proved satisfactory. 
ре пе 
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The leaderless group discussion tech nique 
was used. The S.'s were given the problem to 
read and then discussed it. Ansbacher(l), 
Bass (4), and others have found this a useful 
tool for assessing social skills of group discus- 
sion. The S.'s werestrangersso that a “pure” 
informal group structure might emerge. 

There were several reasons for using the 

leaderless group discussion technique. Inthe 
first place, participation by E. would consti- 
tute a familiar experience for the case-discus- 
sion-experienced S.'s, and they might inter- 
act more freely than would the non-case-discus- 
sion S.’s. However, the non-case- discussion 
S.'s. would not be accustomed to the situation. 
Moreover, any participation in discussion by E. 
would have necessitated a standardized proc e d- 
ure, the same remarks would have had to be 
made in the same sequence for allgroups. This 
would have been impossible since E. was busy 
taking notes. 

As each S. appeared for a session he was 
given a copy of a magazine to read while wait- 
ing. When the group had gathered E. collected 
the magazines, seated Ше S.' s and proceeded 
with the experiment. E. mentioned that the 
session was being tape recorded to insure ac- 
curacy, but that all information would be kept 
Strictly confidential. E. placed numbers 
from one to six in front of each participant, ex- 
plaining that S. 's could be referred to by num- 
ber should anyone so desire. А “warm-up” 
case was distributed and discussedfor five min- 
utes. At the conclusion of this disc us sion the 
first experimental case was distributed, read, 
and discussed for fifteen minutes* E. thensaid, 
“(Write what you consider the best solution." 
When this had been done the S' s completed rat- 
ing scales concerning leadership in this partic- 
ular situation, Communication Data Forms, and 
stated their opinion of the problem. | 

None of Ше twenty-four meetings was inter- 
rupted or interfered with in any way, and rap- 
port was excellent. Once begun, all groups pro- 
ceeded according to the standard methodology. 
The first group met in September, the la st in 
May of the same year. The usualelapsed кше 
for а group meeting was approxima t e ly fifty 
minutes, distributed as follows: 


Introductory remarks..........- 5 minutes 
Problem L..... eee 4.9: 5 minutes 
Problem П................... 15 minutes 
Written воішіоп............... 10 minutes 
Forms and rating scales....... 10 minutes 
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Concluding remarks.............. 5 minutes 
V. The Evaluation Instruments 
A. The Communication Data Form 


On the Communication Data Form,the S. was 
asked to state those with whom he specifically 
tried to communicate verbally and whether or not 
he believed that he had been successful. He was 
also asked to state those whom he perceived аз 
Specifically trying to communicate with him ver- 


bally, and whether or not theseattempts had been 
successful, 


B. The Leadership Rating Scale 


At the conclusion of the group discussion, 
each 5. rated every member of the group, includ- 
ing himself, ona Leadership Rating Scale. TheS. 
was instructed to rate the members according to 
leadership in this particular situation. This 
made it possible to compare the perception of 
each member with the group’s perception. 


C. The Judgment of the Written Solutions 


The written solutions were typewritten оп sep- 
arate pages, and presented in random order to 
eleven judges** The judges were kept purposely 
unaware of the experiment. ‘‘The Badminton 
Problem” was used at all ‘‘before’’? sessions 
and “Тһе Parasol Problem was used at all “ʻa f- 
ter’’ sessions. Since the judgmentcriteria for 
both problems differed only slightly, that for 
“The Parasol Problem’’ has been omitted. 


1. ‘Centering’ Category 


Rationale 


“The Badminton Problem” was analyzed 
according to Wertheimer’s concept of “cen- 
tering’. Wertheimer's principle is that 
adequate problem-solving demands center- 
ing on the total situation. Wertheimer ex- 
plains centering as follows: 


““Centering—the way one views the parts, 
the items ina Situation, their meaning 
and role as determined in regardto a 
core, or radix—is a most powerful fac- 
tor in thinking, › 

“Ав to the concept of ce nteving, it 
seems to be tacitly recognized that 


ж The case used at all "before" sessions was "Two Boys Flay at Badminton" (11, p.121-126), At all "'ef- 
ny nandi the case used was "The Parasol Problem" (Тр. 301-326). 
sess T 


TOM i indivi Я d as judges: Graduate students: Dorothy 
xxThe wri debted to the following individuals who serve r і ents: Do 
жне КЕ ken нь, Charles Puchanan, Barry Crites, Charles Deeble, Granville Fairchild, Orville 
a Элепде11 Walker, Professors: Mary Kinnane, Но Ko L'Ecuyer, Martin Scheerer, 
, Wendell W 
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adequate centering, with its consequen- 
ces for objectivity and justice is of the 
utmost importance” (11:136). 


Criteria 


“А” (older boy) centered 


“В” (younger boy) centered 
. Game or “Бой” centered 
“Outside of the field’’ solution 


BOOP 


2. ‘Inadequate Solutions?” Category 


Rationale 


In his discussion of classroom research, 
Wertheimer pointed out that frequently the 
students handled the problem on a super fi- 
cial level, such as labeling behavior inster- 
eotypes, pronouncing moral judgments, and 
the like. The writer considered that such 
behaviors represented pitfalls or errors in 
problem-solving and this category was set 
up in order to detect such errors. 


Criteria 


Pigeon-holing 

Moralizing 

Ignoring restrictions 

Using a restricted frame of reference 
‘‘Reinterpreting’’ facts 


Фа? 


3. “Means” Category 


Rationale 


By employing this category, E. endeav- 
ored to determine the underlying means 
with which the S. was attempting to cope 
with the situation. This index of behavior 
is important because it tells us muchabout 
the S.' s basic viewpoint toward interper- 
Sonal relations. 
bae Се ЗБЕ was concerned about the 
Dr нара approach of individuals to 
mee interpersonal relations. He 
Инди ред the typical modes of approach to 
the folio minton Problem” and stated that 
Westin wing were the usual types of sug- 
га w a en by his S.’s: Offering can- 
ind ү: уше another game, scolding, ignor- 

» Coercing. (11:128). 

"m sce be noted that the categories which 
ve been designed to encompass 


many of these suggesti i qam 
er has ыы ions which Wertheim 


Criteria 


a. Bargaining 
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Bribing 
Flattering 
Shaming 
Mutual means 


Withdrawal or quitting 


This was the last of the three categories 
designed for recording the solutions to *The 
Badminton Problem. ” 


Reliability of the J udges 


In the present study, each written solu- 
tion was judged independently by two differ- 
ent judges. Reliability was approac hed 
according to agreement per eachcategory 
by both judges. Concerning ‘‘The Badmin- 
ton Problem’’ judges’ agreement was as fol- 
lows: ‘Centering’ Criteria—Agr ее ment 
58 percent, “Inadequate Solutions" 
Criteria—Agreement 65 percent, *Mea ns" 
Criteria —Agreement 55 percent. Concern- 
ing The Parasol Problem", “Concrete 
Action Proposals" Criteria—Agreement 94 
percent, «Centering? Criter ja—Agree- 
ment 66 percent, «Inadequate Solutions i 
Criteria —Agreement 57 percent, *tMeans" 
Criteria—Agreement 74 percent. While à 
higher degree of agreement w ould have 
been desirable, it should be pointed out 
that all agreement criteria were quite rig- 
orous, and the data was very difficult to 


judge. 


горо 


D. The Judgment of the Group Discussion Tran- 
scripts 


It will be remembered that each of the twenty- 
four experimental discussion sessions was tape 
recorded and transcribed. It is true that а 
transcript is а reproduction of actual beha vior 
and subject to limitations inherent in any fac- 
simile; however, these transcripts were made ап” 
der rigorous experimental conditions, andit WaS 
not feasible to have observers present noting the 
interactions. 


Rationale 


The transcript judgme nt design ш- 
volved counterbalancing inorder toaccount 
for three important variables which might 
bias judgment. They were: 


(1) The type of group, whether experimen“ 
tal or control. 

(2) Тһе time of discussion, whether '' be- 
fore" or ‘‘after.”’ 

(3) The problem discussed, whether «Тһе 
Badminton Problem" ог «Тһе Рага- 
sol Problem. ”’ 


—— ЕЕЕ 
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As a preliminary measure, the judges 
were kept unaware of these threeaspects. 
Furthermore, each judge judge d four 
transcripts in a prescribed order. The 
“ABBA” sequence was used, in order to 
counterbalance the variables just men- 
tioned. 

As an additional precaution, each judge 
was told his set of four transcripts might 
include four, three, or two of one kind 
of group (experimental or control) Actu- 
ally, each judge received the four tran- 
scripts from one matched pair, namely: 
Experimental Group No. 1, ‘‘before’’and 
**after" sessions, and Control Group No.1, 
‘‘before” and ‘‘after’’ sessions. It was be- 
lieved that this combination of transcripts 
would result in the complete set of one 
matched group being judged in the same 
frame of reference. 

E. was very fortunate concerning the 
important problem of gaining theassist- 
ance of competent judges. Twelve mem- 
bers of the University of Kansas Staff vol- 
untarily gave generously of their time so 
that this task could be accomplished. Six 
of the judges were psychologists, six 
were teachers experienced іп the case-dis- 
cussion method of teaching. * 


Criteria 


The judges rated each of the four dis- 
cussion transcripts according to criteria 
generally accepted as indicative of group 
functioning. Ratings were madeona con- 
tinuum according to whether the group was 
“high” or ‘‘low’’ on each variable. The 
seven variables judged were as follows: 
Insight, continuity, atmosphere, task-cen- 
teredness, group-centeredness, individual- 
centeredness, and success of communica- 
tion. 


Reliability of the Transcript Judgments 


With regard to agreement conce rning 
type of group, neither the case-discussion 
teachers nor the psychologists who ac ted 
as judges proved superior in being able to 
judge whether or not the transcr ipt was 
from а case-discussion or a non-case-dis- 
cussion group. Moreover, all ofthe 
judges were correct in their judgment con- 
cerning Ше "буре of group” criteria more 
than half of the time. This may be inter- 
preted as indicating that the different types 


x The writer is ind 
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of groups did not have outstanding distin- 
guishing characteristics and tnat neither 
type of judge proved clearly superior. 
Concerning the seven continua ratings, 
agreement was analyzed by computing a 
Spearman Rank Difference Correlation 
Coefficient between the ranks assigned by 
the two judges to the seven variables. 
The results were an average Spearman 
Rank Difference Correlation Coefficient of 
.36. Thus reliability was low, andas was 
` the case concerning the writtensolutio ns, 
either this type of material is difficult to 


judge or it was judged in different frames 
of reference 


VI. Analysis and Interpretation 


In this section the major findings from the 
present study will be analyzed and integrationin- 
to a meaningful pattern. It should be pointedout 
that all the conditions and assumptions inher ent 
in the use of Ше ‘‘t’’ test could not be met. Be- 
cause random sampling was not feasible, alter- 
native procedures were used. The universe of 
potential experimental subjects was relative ly 
small so subjects were chosen in accordance 
with certain rigorous criteria, rather thanac- 
cording to personality or convenience. Control 
subjects who met the same criteria were chosen 
from a large pool in a random manner. Further- 
more, restrictions of time and scope limitedthe 
study to one college and a duration of one year. 
However, Ше “t” test was used because it 
seemed the most appropriate. The limitations 
which have been noted functioned to render the 
conclusions tentative. 

The Communication Data Analysis did not sup- 
port our hypothesis concerning the predicted su- 
periority of the case-discussion group, for the 
results indicated no significant differences. It 
may be that these skills are difficult to master, 
and that three months is not enough time for sig- 
nificant changes to occur. It is possible that 
this measure of communication was notadequate. 

The first discovery of differences between ex- 
perimental and control groups came Írom analy- 
sis of the “leadership” rating scale. It was 
found that there was no significant difference be- 
tween the groups pertaining to the perception of 
the individual 8. vs. the groups’ perception of 
the “leadership” hierarchy. However, further 
analysis indicated that this may have beendue to 
the fact that the range of **leadership" ratings 
for the experimental groups was much more nar- 
row than that of the control groups. It was de- 
termined that this difference was almost statis- 


ebted to the following individuals who served as judges: Professors Louise Barker, 


Lawrence Bee, Carroll Clark, Hilden Gibson, Fritz Heider, Marston McCluggage, Lee Meyerson, Edward 


Go Nelsons 


William Thompson, Charles Warriner, Edward Wike, Мо Erik Wright, 
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tically significant. (P. «.09). This was inter- 
preted as suggesting that the experimental groups 
had excelled the control groups in that the experi- 
mental groups tended to share leadership func- 
tions. This outcome was consistent with other 
predictions that were made. 

Ап analysis of the written solutions to ‘‘The 
Parasol Problem" provided four trends in the 
predicted direction, one contrary trend, and one 
inconclusive finding. None of these was statis- 
tically significant. The first trend involved at- 
tempts to keep the worker on the same work 
team. This шау be interpreted as evincinga de- 
Sire to contain the problem—to solve it with the 
minimum shifting or disturbance of personnel 
and interpersonal relationships. The seco nd 
trend showed that the experimental group pro^ 
duced more solutions that attempted to use the 
worker productively. This may be interpreted 
as demonstrating a desire to use the potential 
of the individual to bring satisfaction to the work- 
er and to the company. 

_ This inference is supported by the third tr end, 
- which the experimental group excelled the соп- 
rol group by centering the problem in Ше most 
adequate manner. This may be interpreted as 
evidence that the experimental 8.” в tended to 
take into account the total situation, rather than 
approach the problem from a restricted view- 
point. It will be remembered that Wertheimer 
emphasized the importance of centering by stat- 
ing that adequate problem-solving demanded ade- 

quate centering. 

The fourth trend in which the experimental 
group demonstrated superiority was the finding 
that the experimental group producedfewer solu- 
tions that violated conditions which were stated 
іп the problem. This was interpretedas meaning 
that the experimental 526 were more willing to 
accept the limitations of the situation. И is gen- 
erally agreed that this is a more realistic ap- 
proach to problem-solving, than an approach 
Which distorts the problem situation so that it 
э а particular solution. The latter ар- 

ты тыу be considered an evasion ofthe task. 
га зы finding permits the resolution of al- 
cerning tid дәретте which were possible con- 
analysis indi -’S opinions of the problems. Our 
voiced the s that the experimental S.'s 
was жекіп riticism that relevant information 
The ева often than did the control 8.5. 
either they ide interpretation was proposed that 
Hons of the ы ест to accept the limita- 
unfruitful Meca eiui they та: ud 
tiat inportant ine , Or ey keenly sensed 
Considered information was lacking, which was 
r red a reasonable criticis m. The fourth 
E the latter interpretation. By their 
n tes the task of writing solutions, the ex- 
will group demonstrated thatthey were 

ng to accept the limitations of the situation, 
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and their criticisms may be interpretedas mean- 
ing that they were more keenly aware ofthelack 
of certain information than were the c ontrol 
group. 

In one respect the groups showed no differ- 
ences. Both achieved identical scores concern^ 
ing inadequacies which were detected by the 
judges in their solutions. The one contrary 
trend stands out clearly. The experime ntal 
groups produced a greater number of solutions 
which involved retirement. This was cons id- 
ered a drastic method of solving the problem 
since other alternatives were poss ible. It 
should be stated that no S. proposed retirement 
as the only solution, retirement was pr esented 
as analternative. Therefore, it may have been 
considered as a last resort if other proposals 
failed. In this context, retirement is preferable 
to discharge, for retirement would benefit the 
worker by providing an income and 
would benefit the company by freeing 
them to hire a capable replacement. 
However, it would seem that the psy- 
chological repercussions the impact 
on the worker and the effect of this action on 
company-worker relationships, — might out- 
weigh these benefits. 

The conclusion drawn from analysis of the 
written solutions was that the margins of super- 
iority of the experimental group were notlarge. 
This may be considered a reflection of the dif- 
ficulty of the problem. Perhaps we should not 
expect an individual to solve adequately а prob- 
lem which six individuals acting as agroup have 
proved incapable of solving after fifteen minutes 
of discussion. This aspect of the study ma y be 
summarized by stating that theexperimen tal 
group excelled the control group on four m eas- 
ures, was excelled by the controlgroup оп one 
measure, and paralleled their performance on 
another one. 

In the matter of group discussion transcripts, 
there were no differences between groups on the 
variable that pertained to the emergence of а 507 
lution from the group discussion, and the adequa- 
су of such a solution—not one group achieved a 
solution, all ran out of time at the “аНег” 5 es- 
sion. On each of the remaining variables, the 
«ср» tests and inspection of the relative mean 
gain differences indicated a consiste п t trend. 
The most striking finding of the present study 
was that the experimental group excelled the 
control group on each of the following seven Var" 
iables: insight, continuity, atmosphere, tas k- 
centeredness, group-centeredness, ind ividual- 
centeredness, and success of communication 
(Table II. Since it is generally agre ed that 
these variables are crucial factors of group dis- 
cussion processes, this performance is impor- 
tant. The score for the variable, “atmosphere 

was statistically significant (P. <. 03). 
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It should be mentioned that one of these vari- 
ables, ‘‘insight’’ is more directly related to 
problem-solving than are the others. The mar- 
gin of excellence on *'insight was low, which 
Seems consistent with the other low findings r e- 
lated to problem-solving. The fact that the ex- 
perimental group functioned more adequately in 
group discussion processes indicates that they 
have made more progress in this direction than 
in the direction of group problem-solving. 

The transcript judgment analysis suggests 
that the overall performance of the experimental 
group surpasses that of the control group, that 
the former group has made more progress in 
group discussion skills. This is important, for 
it is generally agreed that these skills are pre- 
requisite to group problem-solving skills. 


VIL Recommendations for Curriculum Change 
—— ns tor Curriculum Change 


The fruitfulness of a study requires that it 
yields implications which extend beyond the ex- 
perimental situation. The writer trusts that the 
study will prove heuristic, and believes that the 
results warrant the suggestion of certain practi- 
cal applications and further experimental possi- 
bilities.« 

In the matter of curriculum improvement, the 
data tend to give some support to the contention 
of other studies that case-discussion courses 
provide valuable experiences that are not usual- 
ly gained in the typical lecture method course. 
Concerning case-discussion courses of the 
Human Relations type, it seems that it might 
prove profitable to extend the training period, 
alter the type of training, or effect some combi- 
nation of these possibilities. 

It often happens that training in case-discus- 
sion classes cannot afford all members equal op- 
portunities to learn group interaction process 
and group problem-solving skills because large 
enrollments curtail individual participation. Our 
results indicate that students need to become ac- 

customed to vis-a-vis relationships apart from 
the classroom situation, so thata transfer of 
learning will be effected to areas more within 
the scope of daily interpersonal relationships in 
college, in work, and in social situations. Un- 
less this happens, students may be c onte nt to 
permit the teacher to assume responsibility for 
furthering group interaction processes. Our re- 
sults seem to indicate that a promising begin- 
ning has been made, but there is no room for 
complacency, further progress is essential. 
Perhaps more participation, and experience 
in small groups could be managed by increasing 
the training period and instituting changes in 
methodology. Under the guidance of the teacher, 
a permissive atmosphere for classroom discus- 
sion could be established at the beginning of the 
course. Later, the classroom group could be 
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encouraged to institute its own observer-feed- 
back-evaluation procedure and these functions 
could be shared by the members. 

Concomitantly, students could be provided 
with experience in functioning as members oí 
small groups, so that each individual would have 
а greater opportunity to function asa r es ponsi- 
ble group member. The institution of small, 
leaderless groups would tend to maximize indi- 
vidual responsibility. It is hoped that these sug- 
gestions do not appear too unrealistic, at least 
some combination of these possibilities m ight 
prove feasible. Finally, if some of these sug- 
gestions were put into practice, further experi- 
mentation would become imperative in order to 
test the effectiveness of such procedures. 


УШ. Conclusion 


The gains made by the experimental group 
have been modest and they have been, with few 
exceptions, in the predicted direction. Statisti- 
cally only one of these gains was significant 
but this must be considered in the context of the 
Situation in which they were accomplished. 

The experimental situation represented a 
novel experience that was a wide departure 
Írom classroom routine as practiced incase-dis- 
cussion method courses from which the experi- 
mental S.'s had been drawn. Moreover, there 
is evidence that “Тһе Parasol Problem" which 
was the crucial test, was a very complex prob- 
lem. Finally, one must take into account the 
brevity of the training period—only three hours 
per week for three months —and the factthat this 
type of training was diametrically opposed to tra- 
ditional methods. 

When these conditions are taken into consider- 
ation, the writer believes it would be unrealistic 
to expect Sweeping advances. Inthe writer’s 
opinion, an appreciation of these aspects leads 
One to conclude that these modest gains r epre- 
sent an important achievement which may be at- 
tributed to the case-discussion method of 
teaching. 


REFERENCES 


1. Ansbacher, H. L. » “Тһе History of the 
Leaderless Group Discussion Tec hnique, ’’ 
Psychological Bulletin, Vol, XLVIII, No. 5, 
September, 1951, pp. 383-391, 

2. Bales, Robert F., etal, “Channels of Com- 
munication in Small Groups," American 
Sociological Review, vo], XVI, No. 4, Au- 
gust, 1951, pp. 461-468. 

3. Barker, Roger С. and Wright, Herbert F., 
Methods in Psychological Ecolo ‚ Law- 
rence: University of Kansas Press, 1950. 


e 


September 1956) 


4. Bass, Bernard M. and Klubeck, Stanley,“ Ef- 
fects of Seating Arrangement on Leader- 
less Group Discussions," Journal of Ab- 
normal and Social Psychology, Vol. XLVII 
No. 3, July, 1952, pp. 724-727. 

9. Berrien, Е. K., Comments and Cases on 
Human Relations, New York: Harper and 
Bros., 1951. 

6. French, John В. P., Jr., ‘Organized and 
Unorganized Groups under Fear and Frus- 
tration," University of Iowa Studies in 
Child Welfare, Vol. XX, 1944, pp. 231-308. 

7. Maier, Norman R. F., Principles of Human 
Relations, New York: JohnWiley andSons, 
Inc., 1952. 

8. Ostlund, Leonard А., *ASociometric Matrix," 


OSTLUND 89 


Proceedings of The Oklahoma Academy of 
Science, Vol. XXXIV, 1953. 


9. Ostlund, Leonard А. , “Group Integrationina 
Case-Discussion Course, ’’ Journal of Edu- 
cational Psychology, Vol. XLIV, №. 8,De- 
cember, 1953, pp. 463-474. 

10. Stephan, Frederick, *TheRelative Rate of 
Communication Between Members of Small 
Groups, ” AmericanSociological Review, 
Vol. XVII, No. 4, August, 1952, pp. 482-486. 

11. Wertheimer, Max, Productive Thinking, New 
York: Harper and Bros., 1945. 

12. Wispe, Lauren G. , ‘‘Evaluating Section Teach- 
ing Methods in the Introductory Course," 
Journal of Educational Research, Vol. XLV, 
No. 3, November, 1951, pp. 161-186. 


DO PROBATIONARY COLLEGE FRESHMEN 
BENEFIT FROM COMPULSORY STUDY 
SKILLS AND READING TRAINING? 


WALTER S. BLAKE, JR. 
University of Maryland 


WHEN THE facilities of the University of 
Maryland were extended to all prospective stu- 
dents below certification average in 1947, univer- 
Sity policy dictated that students admitted with- 
out the certification average be put on probation - 
агу status and given study and reading skills 
training. As a result, the persistent and im- 
portant problem of how to assist college fresh- 
men make a good adjustment in the college 
melieu has received a great deal of attention 
at Maryland Universiti. 

"Ws problems are multi-causalandtherefore 
"на. кч, but not essentially differ ent than 
ы е сей by college freshmen before World 
а II^. At Maryland University, the problems 
have been made more acute by the ever-increas- 
ing number of applicants for admission, plus the 
mediocre quality of training being givenin too 
many of the primary and secondary schools in 
the states from which the University draws its 
Students. Two types of students have been put 
on probation Since the program's beginning: (1) 
applicants for colleges demanding a higher level 
of academic achievement than high school 
records indicate will be attainable to the appli- 
cants; and (2) students who are dropped from one 
college for scholastic deficiency and who wish to 
transfer to another degree-granting college upon 
being readmitted by the Committee on Admis- 
Sions, Guidance, and Adjustment. If a student 
thus admitted fails to earn a 2.0 (C) average 
over two semesters he remains on probation un- 
tilhe does earn the 2. 0 average. 

The Maryland program is unusual in that few 
voluntary enrollees are accepted. Present facil- 
ities do not permit further expansion, although 
many requests for admission are received from 
non-probationers and/or their advisors. Upwards 
of 800 students are enrolled, representing every 
деве оп campus. Lectures and laboratory ses- 
ана comprise the first semester study skills 
еды (College Aims 1); combined lecture and 
i ratory experiences are used in the rea ding 
PR ant Course given the second semester 
= ir Aims п). Tutoring in English, as well 

athematics is offered the studentsand 


is available upon request of students. Remedial 

reading instruction and counseling interviews 

complete the program services, all of which аге 

offered primarily to help students learn to work 
up to their capacities and effect a good social ad- 
justment in college and all their lives. 

In 1952-1953 the program was evaluated in an 
effort to determine, in part, whether probation- 
ary college freshmen do benefit from the compul- 
sory study skills and reading-improvement train- 
ing. Two main areas were investigated; (1)the 
academic performance of students during and fol- 
lowing the training given; and (2) the 5 tudents’ 
opinions of the program. The aca demic рег- 
formance of the students was measured in зеуег- 
always. The sociology grades of 128 probation- 
ers after training in study skills averaged 7 0. 47 
for one semester as compared to 75.60for 122 
members of a control group. Reading tes ts re- 
vealed that the average reading speed of 139 pro- 
bationers was 247.3 words a minute before train- 
ing began, and had improved to 406. 0 at the con- 
clusion of the reading course, with comprehen- 
sion remaining practically unchanged. 

One follow-up study? was made todeterm ine 
the degree of academic success experienced by 
128 probationers and 122 control-group students, 
over a four and one-half year period. 22. 6% of 
the probationers graduated in the 4-1/2 year per- 
iod as compared to 22. 9% of the c ontrol group. 
Also, of the original 128 probationers who at- 
tained the 2. 0 (C) average necessary to enable 
them to get off probation, 47. 3% went on to grad- 
uate (14.5% of this group was still in school at 
this writing) Š 

A follow-up study of a second group oí proba- 
tioners is summed up in Table I. This table clear- 
ly indicates that a large number of lower-ranking 
members of the group do succeed. It would seem 
that the academic success of the probationers 
was considerable, at least partly due to the train- 
ing provided in the study and reading skills рго- 

gram. 

The anonymous student evaluation of the pro^ 

gram was particularly enlightening. Studen ts 
would rather be-admitted on a non -probationary 


1. ius article is based upon a doctoral study completed in 1953 by the author which is one of the 
es for the textbook, College Orientation (2nd printing), coauthored with George Weigand, pub- 


lished by Prentice-Hall, Ince, ° 


nse Periode 


2 қ 
š ыы Willard We, and Everett He Hopkins, Counseling College Students During the Defe 
lashington, D. Ce: Office of Education, Federal Security Agency, 1952» 


Зе Mrs. Martha Maxwell, assistant to the director of the program, conducted this study. 
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rather than probationary basis when they apply 
for admission to a college or university, of 
course; but, once put on probation and required 
to complete a study skills and reading impr ov e- 
ment program, do students then recognize that 
the experience has helped them? A systematic 
and entirely anonymous student evaluation was 
undertaken at the University of Maryland in an 
attempt to answer this question. Overaperiod 
of three semesters (1951-1953) 599 participants 
in the program were asked to evaluate their əx- 
beriences anonymously: 72 were enrolled in а 
lecture class, and 340 were students in the lab- 
oratory of the study skills course;andthe remain- 
ing 187 were in the reading improvement course. 
- = r. evaluation revealed that 54 oí the 
uu e pes of the Spring, 1952, class were fa- 
ВАН a еселі to Ше lectures; 50 were inter- 
iv ei he extent that they volunteeredconstruc- 
= &gestions to improve Ше lectures; and 
н y could remember, and did write down Ше 
YS the lectures helped them. (There were 83 
Such responses. ) 
PRA laboratory evaluation, involving 344 stu- 
и делді а period of three successive semes- 
2 all, 1951-52 through Fall, 1952-53), indi- 
ed that only 20 students (5. 8%) felt they had 
ее little or no help; 171 (49.7%) indicated 
b t the assistance they received was either 
considerable” or **great;" 143 (41.6%) felt 
they had received “some help;" only one felt 
that no help whatsoever had been received; 10 
(2. 9%) did not respond. Also 236 (68. 6%) stated 
that they were encouraged to investigate a nd at- 
tempt to solve their study problems as against 
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88 (25. 6%) who were not stimulated in this man- 
ner (5. 8% did not volunteer comments in this 
area). 255 (71.2%) could remember, and did 

write down the laboratory periods whichhelped 

them most; and 131 (38. 0%) could remember and 
did write down the laboratory periods which 
helped them least. 

The reading course evaluation, involving 187 
students over the Spring and Fall semesters of 
1952-1953, indicated that only 9 (4. 8%) felt th ey 
had received Пие” help; while 122(59. 9%) 
stated that the help they had received was either 
“considerable” or ‘‘great ;’’ and not one felt that 
һе had received no help at all. 158 (84. 5%) felt 
stimulated to investigate and attempt to solve 
their study problems, while 29 (15. 5%) were not 
stimulated in this manner or did not volunteer 
this type of response. Significantly, -138 (73. 8%) 
noted reading improvement in other univers ity 
courses; а total of 49 (26. 2%) either had no such 
experiences, or did not respond in this area. 

Іп summary, it seems evident that the stu- 
dents who were assigned to a probationary status, 
and were required to participate in the University 
of Maryland study skills program, were benefit- 
ed academically. Also, the great majority rec- 
ognized and stated the benefits they felt they re- 
ceived despite the opportunity to be abusive which 
was open to every student in an anonymous evalu- 
ation of this sort. Inview of the findings re- 
viewed here it appears that the compulsory train- 
ing given students does help many achieve their 
immediate goals despite the stigmatization suf- 
fered in varying degrees by students when first 
placed on probation. 
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TAIN ENVIRONMENTAL FACTORS TO 
TEACHING SUCCESS 


" WILLIAM B. KNOX* 
Platteville State Teachers College 
Platteville, Wisconsin 


SECTION I 
INTRODUCTION 


THIS STUDY seeks to ascertain the relation- 
Ships of certain environmental factors to teach- 
ing success. The environmental factors to be 
Studied include the many conditions and facili- 
ties, present or absent, in a given situation that 
may influence the teacher's effectiveness. А po- 
tentially upsetting condition may be present or 
absent but a particular individual may, because 
of his temperament or philosophy of life, not be 
upset by it. Even though individuals vary great- 
ly in adaptability to situations, it would seem 
desirable to ascertain the aspects of the environ- 
ment to which teachers react unfavorably and 
express beliefs and attitudes which may influ- 


ence their effectiveness. 

Assuming that environmental factors ex- 
Pressed in an attitudinal manner may influence 
the effectiveness of a teacher, this study seeks 
to answer the following questions: 


1. With what situational factors do teachers ap- 
pear to be most satisfied or dissatisfied? _ 

2. What situational factors seem to be associat- 
ed with teaching success? 

3. To what degree can teacher 5 
dicted on the basis of situatio 

4. What situational factors do teacher 
Should be changed? 


uccess be pre- 
nal factors? 
s think 


effectively predict and 
over a longer per- 
o know 


In order that we can 
Control the behavior of people 
. iod of time it would seem advis ablet 

. more about the situation in W 
А better knowledge of the envifonment, an 


individual's reactions to it, should 1e2 
control. 


higher de iction and 
gree of prediction t вате сасне? ва 
thers. The— 


E It is common observation Ша 
ituations are more complex than 0 


eciation to 


*The aut i his appr 
hor wishes to express рр: $ his gradua 


and encouragement during the course 0 


d to а Date 


mendations for t 
teaching efficiency that, 


recognition of the environment as an important 
aspect of living was pointed out some yearsago 
by the sociologist W. I. Thomas (27). He indi- 
cated the areas in which the investigation of be- 
havior problems may be profitably pursued, viz., 
“the attitudes, the values, the forms of adapta- 
tion, and the total situation. 2 


In any study of human relations there is need 
of a psychology that provides adequate recogni- 
tion of environmental factors. Such a psycholo- 
gy should give an adequate social consideration 
to relations and forces in a dynamic interactive 
situation. Lewin (16) concludes: “Every psycho- 
logical event depends upon the state of the per- 
son and at the same time on the environment.... 
The experimental work of recent years shows 
more and more this twofold relationship in all 
fields of psychology. Every scientific psycholo- 
gy must take into account whole situations, 1.е., 
the state both person and environment. ” Murphy 
(21) states, ‘It must be recognized that the slight- 
ing of situational differences has been a constant 
source of clinical and experimental errors; the 
clinical interview and the laboratory have both 
consistently failed to predict adequately the na- 
ture of social behavior that occurs in situations 
other than those in which the observations are 
originally made. The laboratory psyc hologist 
and the clinician have both conceived the individ- 
ual аз a system of events and tendencies carried 
around within the skin of the individual subject. 
They have both assumed that his delinquencies or 
his triumphs, his interests or his nervous mal- 
adjustments, result fully and simply from struc- 
tured disposition within him. ” Murphy goes on 

say that “а study of situations that act upon 


Ув ons 5 tas full and ав system- 
hich people por зи а и structures which 
| the DiVID Ревропамейжече situatior s.” 


-“Вагт-43) indicates іп à summary of recom - 
he study of the prediction of 


s constant inspiration, guidance 
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te study and the completion of this investigation, 
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More attention should be given to the sit- 
uational factors in success. П 15 easier 

to succeed in some situations thanothers. 
More attention needs to be given to these 
situational aspects of efficiency. 


McClusky and Strayer (19), using a teacher 
situation test, came to the conclusion that 
**practically every phase of the teacher's life, 
ranging from his relation to the community to 
his attitude toward equipment in the classroom, 
is involved in his adjustment.” Barr and Low 
(17) found a positive correlation between the 
complexity of teaching situations and tea c hing 
success. Again, in a summary of recommenda- 
tions, Barr (3) concludes, “ТЕ is probably er- 
roneous to assume that specific acts are good 
or bad divorced from purposes, principles, per 
sons, and 5іїцайоп5...." 

It would seem that in light of these ps ycho- 
logical observations and the attitudes expressed 
as to the importance of environmental factors in 
predicting behavior, that this problem is one of 
paramount importance. 


Research Directly Related to the Problem 


The paucity of research directly related to 
this area of investigation is probably due to the 
elusive character and the complexity of the ele- 
ments that are the components of the environ- 
ment. 

It is important to know the personal charac- 
teristics of an individual. Such knowledge en- 
ables one to understand, at least in part, the 
actions of individuals in any situation. It is be- 
coming increasingly recognized, however, that 
this alone is not sufficient. Екен 

Lins (17) studying 58 women teachers іп Wis- 
consin schools, using a composite of five super= 
visory ratings, reports a composite evaluation 
of the situation with a correlation of -. 34. Gar- 
rison (10) concluded after investigating job sat- 
isfaction of 46 women college seniors who had 
just finished 8 weeks of practice teaching and 
42 elementary women teachers in service tha G 
“Although the teacher-pupil relationship is of 
utmost importance in relation to sati sfaction, 
many other situations in the teacher's life af- 
fect the teacher's feeling of satisfaction.” Si- 
mon (21) after studying the records of action 
taken in the dismissal of 769 teachers and ad- 
ministrators concludes, “Тһеу were unable to 
make satisfactory adjustments. Тһе teacher's 
inability to adjust himself to the community or 

to the school environment will cause him to be 

unpopular with the pupils and parents and may 
cause boys and girls to dislike the subjects he 
teaches." Symonds (26) had 65 teachers write 
a paper telling how they solved their p ersonal 
problems. Тһе thrée problems most frequently 
mentioned in their themes, in order of frequen- 
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Cy, were: feelings of inadequacy and inferior- 
ity, professional difficulties, and family rela- 
tions. Since living does not occur in a vacuum 

it might be well to know in such cases what the 
Situational factors were that lead to the buildup 
of these problems. Martindale (18) gathered 
data from 72 teachers by means of a Teacher 
Situation Inventory that contained 316 situational 
items. He attempted to ascertain thefactors that 
presumably lay outside the personali ty of the 
teacher. He maintained, 


As individual teachers differ in many 
ways so do all schools and communities 
differ. Some schools are progressive 
while others are conservative; some com- 
munities are friendly, others aloof; some 
are tolerant, others exacting. Population 
makeup, wealth, cultural status ,and 
many other factors create differences 
in schools and communities. Every school 
and community is unique just as every in- 
dividual person is unique. 

It is logical to suggest, then, that some 
of the factors influencing teaching suc- 
cess might possibly lie outside the teach- 
er's control and within her... Po sses- 
sion of certain factors commonly associ- 
ated with teaching success is not suffi- 
cient to predict Success; factors which 
predict success might be conditioned by 
the teacher’s compatability with her teach- 
ing environment. 

Numerous instances of an apparently 
well-trained and well-qualified teacher 
failing in one community while succeeding 
in another can be cited by superintendents 
and placement officials. 


Martindale reported a correlation of .19 be- 
tween teaching success and satisfaction 
scores. 

The work that has been done in the area 
of the situational factors as related to teach- 
ing effectiveness is inconclusive. Man y 
studies have been reported that place the 
emphasis on personal factors operating in 
some poorly understood environmental ше- 
dia. The concern of this investigation is to 
identify certain environmental factors which 
may influence the prediction of teaching suc- 
cess. 


SECTION II 
DESIGN OF THE STUDY 
A DESCRIPTION of the subjects, the instru- 


ments used to collect the data, and proposals for 


analyzing the data will be presented in this вес- 
tion. 
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Description of the Subjects 


This study is a descriptive investigation of 
the situational factors that may influence the ef- 
fectiveness of teachers. The subjects of the in- 
vestigation were sixty seniors who had graduat- 
ed in 1950 from a four-year course inthe School 
of Education at the University of Wisconsin. The 
group is divided into two sub-groups: one group 
of 45 was composed of 45 individuals who re- 
Sponded to a questionnaire; and a second group 
of 15 non-responding individuals who were inter- 
Viewed. A summary of the number of majors 
and minors by fields of study for the group of 45 
15 given in Table I. 

From an examination of the data in Table Iit 
can be seen that there was a concentration in the 
fields of English and General Science and an 
even spread іп the other subject fields. In the 
group of subjects used in this investigation there 
Were 22 women and 23 men. Тһе men hadanav- 
erage age of 25.7 years with a range of 22 to 30 
inclusive. Seventeen of the men had military 
Service. Only two of the women had military 
Service. The women's average age was 23. 2 
With a range of 21to 30 years. The average age 
for both men and women was 24. 5 years. 

The personal information secured relative 
to the subjects of this study showed the follow- 
ing: The men had 21 younger or older brothers 
with a range in number of 1 to 4. They also had 
21 older or younger sisters with a range in num- 
ber of 1 to 3. The women came from families 
with fewer younger and older brothers, but 
there were more older sisters. 

It appears in the matter of residence that the 
families of these persons were relatively stable 
and moved only within the confines of their com- 
munity. The number of schools attended, the 
Occupation of the parents, and population с ent- 
ers, in which they lived at one time, indicate 
this fact. Table H indicates the number of 
Schools attended. — 
. The subjects of this investigation Jived in var- 
ious sized communities as indicated in Table IV. 

In the number of jobs held for pay the women 
Worked most frequently in the clerical and sales 
areas. The men performed manual labor, and 
mechanical and factory work with nineteen hav- 
ing experience in the professional and technical 
fields, 
не 8 to the leadership experiences, the men 
[ens as many class officerships аз women, the 
: ter had more experiences 25 Sunday school 
teachers, tutoring others and serving on councils 
род Committees, The men had most of their ex- 
losen as camp counselors, Scouts, ae 
ing а TS with a scattering of Sunday Schoo. 

nd tutoring. While attending college there 
*re nine men and two women who were 5 elf- 
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supporting. Eleven of the men and five women 
were married at the time of this investigation. 

Comparative data for the members of this 
study. and a group studied by Lins (17) and Mon- 
tross (20) are given in Table V. The grade point 
average for the required Education courses 13, 
74, and 75, which includes practice teaching is 
given as well as the total four-year grade point 
average for various groups. 

A follow-up interview was made of fifteen of 
the subjects of this investigation who did not re- 
spond to the Situation Inventory. In this group, 
selected at random, were four men and eleven 
women with major fields of study as follows: 4in 
English, 3 in Physical Education, 2 in Art Educa- 
tion, 1 in Physics, 2 in Natural Science, lin 
Home Economics, 1 in Speech Correction, and 
1 in History. Their minor fields were French, 
Spanish, Political Science, General Science, Math- 
ematics, English, Botany, Zoology, Chemistry, 
Sociology, and Speech. 

The mean grade point for Education 73, 14, 
and 75, and Ше four-year grade point average 
for the sample did not differ markedly from the 
larger group of subjects studied (Table VI). 

It appears, from the data given in Tables V 
and VI that the subjects of this investigation, are 
representative of University of Wisconsin grad- 


uates. 
Description of the Data-Gathering Devices 


A. Teacher Situation Inventory 

The Inventory (Appendix A-1*) used in this in- 
vestigation was, in substance, the same as the 
one devised and used by Frank Martindale in his 
study of Situational Factors in Teacher Place- 
ment and Success (18). The directions for filling 
out the inventory were extensively revised, how- 
ever, by the present investigator to facilitate the 
logical step by step procedure in completing the 
inventory. The format for the write-in space 
was also changed. 

The revised inventory consisted of two pages 
of directions and nine sections of items listed un- 
der the following categories: the community, the 
people of the community, the school plant, the 
school administration, the school organization, 
the instructional materials, the faculty, the stu- 
dents, and the particular position. These nine 
categories made a total of 317 items. Theaim 
of the inventory was to determine the degree of 
satisfaction and dissatisfaction of each respond- 
ent with respect to the several items and the 
reason for his responses. The last page of the 
inventory consisted of a request forgeneral infor- 
mation. 


B. How the Data Were Collected 


The data for this investigation were secured 
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TABLEI 


MAJORS AND MINORS 


Men Women Total 
Field of Study Major ‘Minor Major МШ Major — Minor 
American Institutions 3 3 0 
Art 3 1 4 0 
Business Education 2 2 4 0 
Chemistry 1 1 0 
Economics 4 2 0 6 
English 2 6 6 6 8 12 
General Science 6 3 5 3 11 
History 4 4 4 4 
Home Economics 4 4 0 
Languages 2 6 2 6 
Mathematics 3 1 1 1 4 
Music 1 1 0 
Physical Education 4 4 0 
Speech Correction 1 3 4 0 
Others 2 1 2 1 
Total 29 ica 45 
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TABLE II 


NUMBER OF SCHOOLS ATTENDED 


Type of 


Number of Schools Attended 


Women 


Number of Schools Attended 


School 1 2 3 4 i " z 
E 
lementary 12 5 5 0 19 4 0 
Secondary 19 3 0 0 20 3 0 
С 
ollege 16 4 1 1 18 5 0 
T 
каче 4 0 0 0 1 0 0 
TABLE III 
OCCUPATIONAL STATUS OF WOMEN 
Men Women 
Agent, Freight Accountant 
Agent, Purchasing Baker 
Assembler Banker 
Attendant, Filling Station Bus Line and Transfer 
Buyer 


Baker 


Buyer, Cheese 


Clerk, Railroad 


Farmer (3)* 


Foreman, Brass Factory 


Foreman, Paper Mill 


Grocer (2) 
Investment 
Janitor (1) 
Lawyer 
Merchant 
Minister 
Oil Dealer 
Postmaster 
Store Owner 


Clerk, Store 

Dealer, Electrical-Plumbing 
Farmer (4) 

Forewoman, Factory 
Gardner 

Janitress (3) 

Manager, Office 
Physician 

Professor, University 
Saleslady, Auto 

Scrap Metal Dealer 
Superintendent of Schools 
Trucker 


"Indicates the number in that category. 
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TABLE IV 


NUMBER AND AVERAGE YEARS LIVED AT SOME TIME IN THEIR LIVES 


Men Women 
Size of Community No. Ave. No. Ave. 
Farm 4 10 4 IT 
Town under 500 4 10 2 21 
500 to 2500 7 13 5 12 
2500 to 10, 000 8 15 6 10 
10, 000 to 100,000 9 11 12 15 
Оуег 100,000 6 17 4 13 
TABLE V 


А COMPARISON OF MEAN GRADE POINT AVERAGES 


Mean 
Measure 1 е 5 
Education 73 
Education 74 2.18 2.31 2.34 
A 2.13 2.13 2.02 
Education 75 1.90 2.37 3 n 
Total Four Year Grade Point Average 1.84 1. ч E 
Total Four Year С.Р.А. of 586 Education Е - 
Seniors who graduated іп 1950 2.02 
Total Four Year G. P. A. of 4577 ай Uni- 
versity graduating seniors 1.88 
Key 


1. Subjects of this investigation 
2. Study by Montross 
3. Study by Lins 
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TABLE VI 


MEAN GRADE POINT FOR THE SAMPLE IN COMPARISON WITH THE SUB- 


JECTS OF THIS INVESTIGATION 


Mean 
Measure 1 2 

Education 73 2.06 2.18 
Education 74 2.33 2.13 
Education 75 2.06 1.90 
Total Four Year Grade Point Average 1.98 1.84 
Total Four Year G.P. A. of 586 Education 

Seniors who graduated in 1950 2.02 
Total Four Year G. P. A. of 4577 all Uni- 

versity Graduating Seniors 1.88 


Key 


1. Fifteen subjects of the sample 
2. АП subjects of the investigation 


TABLE VII 


ORIGINAL SCALE AND WEIGHTING SCALE 


1 +2 
2 +1 
3 0 
4 -1 
5 -2 


extremely satisfactory, 
highly agreeable 


mild satisfaction or 
agreeable 


neutral, not affecting 
liking or disliking 


mildly unsatisfactory, 
disagreeable 


extremely unsatisfactory, 
highly disagreeable 
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-up study of sixty-five 1950 gradu- 
s poA of Education at the University 
of Wisconsin in their first year of teaching. The 
Teacher Situation Inventory (Appendix Same oaa 
sent by mailto each member of this group = 
ing the last month of the first year of his teach- 
ing experience. A letter inviting continued co- 
operation was sent with the inventory (Appen- 
dix A-2). Two follow-up letters were sent sub- 
sequently to those who were tardy in returning 
the inventory (Appendix A-3 and A-4). Forty- 
nine returned a filled-out inventory. Of those 
returned, four were not usable because of the 
omissions and inadequacy of write-in replies as 
to why they expressed a degree of satisfaction 
or dissatisfaction. 


C. The Criteria of Teaching Success 
The criteria used in this investigation were 
as follows: 


1. Acceptability Rating 
This is a rating used in an investigation by 
Ташке! and Ringness2. It was obtained by 
interviewing the principal or superintendent. 
After rapport had been established the follow- 
ing questions were asked to obtain his over- 
all rating of the teacher: 

a. How do you like this teacher? 

b. Does she get along well with the stu- 

dents? 

с. Do the parents feel the same way as 

the pupils do about the teacher? 

d. Is the teacher happy here? Does she 
have friends on the faculty, in the com- 
munity, and the like? 

- Does the teacher have any particular 
weaknesses or Strengths? 
In terms of beginning teachers with 
whom you have worked in the past, 
and in the light of our discussion as a 
whole, would you consider this teacher 
as among the best, above average, av- 


erage, below average, or failing as a 
teacher? 


The above subjective rating thus obta ined 
from a supervisory or administrative Official 
was defined by Ringness? as, **.. . that qual- 
ity of the teacher which leads other people to 
feel that she should be retained in positionor 
possibly be promoted to more responsible as- 
signments. ”’ 


1. Tom Arthur Lamke. Personality and Teaching Success 


Madison, Wisconsin, im 


2. A short form of the Wisconsin Adaptation of 
the M-Blank (Appendix A-5) was used to ob- 
tain the principals’ or superintendents’ esti- 
mate of the teachers' performance. The Adap- 
tation, which was the work of Barr and others 
is a modification of the M-Blank of the Evalu- 
ative Criteria. This Blank in this study in- 
cluded: 


а. Elements of Strength in the Teacher's 
Work 


b. Elements of Weakness in the Teacher's 
Work 
с. General Evaluation: Outstanding, Above 


Average, Average, Below Ave rage, 
Poor 


d. General Comment 


3. A peer rating scale (Appendix A-6) was sent 
to a co-worker who was acquainted with the 
particular subjects’ work. It contained the 
following: 

a. How do you rate this teacher on c оор- 
eration with you іп school enterprises? 
b. Do you find this teacher pleasant and 


agreeable? 

с. How do you rate this teacher on social 
intelligence? 

d. What is your Opinion concerning this 
teacher's physical vitality and health? 

€. What is your opinion concerning this 
teacher with respect to industry and de- 
pendability? 

f. 


To what extent does this teacher parti- 

cipate in community affairs? 

в. How well does this teacher know his sub- 

ject matter fields? 

How do you classify his relations hips 

With the student body? 

- You are asked to make an overall evalu- 
ation of this teacher. If you were to rank 

all teachers of similar positions, in 

which fifth would you placethis teacher? 


4. The judgment of a Supervisory official of the 
State Department of Public Instruction and 
designated as criterion (X). 


These criteria were used singly and as а com- 
posite of the four measures. In addition, where 
the subjects of this investigation overlapped with 
those of Montross (7), his **Number Опе” сош- 
Posite criterion was used. This **Number One" 
Composite included the Principal’s Acceptability 


» unpublished manuscript, University of Wisconsin, 


ng Success, Un- 
В 


2. Thomas А. Ringness. Relationships Hetween Certain Attitudes Towards Teaching and Teachi; 
published PhD. Dissertation, niversity of Wiseonsin, 19 
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rating, Ше Principal's M-Blank rating, Rater 
1 and Rater 2. 

The effectiveness of each teacher was meas- 
ured through the use of these instruments as 
guides to the judgment of the rater. 


D. Treatment of the Data 

The data are tabulated and the mean fre- 
quency of the response to each item tabulated. 
The mean scores designating satisfaction and 
dissatisfaction were correlated with efficiency 
Scores on the above named criteria. Selected 
items of the Inventory, that show low dissatis- 
faction and high satisfaction scores with a s um- 
mary of responses given by the subjects of this 
investigation for such items, are reported. 


SECTION III 
ANALYSIS OF DATA 


THE PURPOSE of this study is to ascertain 
the relation of certain environmental factors to 
teaching success as measured by the efficiency 
Scores in this investigation. 

, The primary sources of data were the teach- 
ing efficiency ratings assigned by experts and 
the responses of the teachers to the Teacher Sit- 
uation Inventory. Respondees checked each 
item of the Inventory using a +2, +1, 0, -1, and 
-2 scale to indicate degrees of satisfaction and 
dissatisfaction. This scale was retained incom- 
puting totals, also the plus, minus and neutral 
responses were assigned values from 1 to 5 as 
Shown in Table VII. Using the weighted scores 
facilitated the handling of grouped data; retain- 
Ing the algebraic scores facilitated rapid identi- 
fication of items to which respondees indicated 
dissatisfaction and identification of individual 
teachers who indicated dissatisfaction. 

The response to each item of the inventory 
by each respondent was recorded as shown in 
Appendix B-1. The responses of each individu- 
al were entered in а working chart of which 
Table ҮШ is an example. In this table the re- 
m to items in the nine categories ofthe in- 
itene = are listed. Both methods for scoring 
adas were employed to arrive at a total weight- 
аг Гог each category. A mean weighted 
tor s 9 each category, a total algebraic score 
tego category, a total weighted score for all 
вогієз les, a mean weighted score for all cate- 
Borles' and a total algebraic score for all cate- 

Was calculated. 


танде total mean weighted score for all cate- 


Богу, 
Of each 
table (Table үх). 

€ summarized inventory information was” 


| Abs 


ae 


S, the mean weighted score for each cate---7^ 
апа the algebraic score for each categokyiur 
respondee were entered into a summary 11410 
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then transferred to a final master chart, Table 
X. Inthis table is recorded each respondee num- 
ber, sex, four teaching efficiency ratings, a peer 
rating, a composite of three efficiency ratings 
anda peer rating. Finally, the satisfaction-dis- 
Satisfaction scores were converted into percents. 
The percent satisfaction-dissatisfaction score 
was obtained by subtracting 3. 00 from the mean 
Score and dividing by 2 when the mean score ex- 
ceeded 3.00, and by subtracting the mean score 
from 3.00 and dividing by 2 when the mean score 
was less than 3. 00. 

It should be noted in the method of scoring ex- 
plained above that the teachers may respond neg- 
atively, positively, or neutrally to any givenitem. 
If the teacher responded favorably he was given 
a plus score; if he responded negatively he was 
given a negative score. If he responded neutral- 
ly he was given a zero score. It should be fur- 
ther noted that each teacher may respond either 
positively or negatively in two degrees of inten- 
Sity, namely, minus 1 or minus 2, negatively, 
and plus 1 or plus 2, positively. When one adds 
Such a series of scores the final sum will havea 
plus or minus sign which represents a mixture 
of frequency and intensity, i.e., a teacher may 
get a negative score by responding negatively to 
a large number of items mildly (-1) or to a les- 
ser number of items strongly (-2). The same 
explanation applies to the positive responses. 

When we speak of a percent of satisfaction or 
dissatisfaction we are speaking of an abstract 
value derived by dividing by 2 the theoretical 
mean for all items (3. 00) minus the particular 
teachers' mean upon the particular items con- 
cerned. 

One hundred percent satisfaction means max- 
imum satisfaction with all items. Alldepartures 
from neutrality are expressed by a fraction, the 
numerator of which is the deviation of each indi- 
vidual's score from 3.00 over a denominator of 
2. This fraction is used to represent the m axi- 
mum possible deviation. A plus score of 2 rep- 
resents complete satisfaction to any given item 
and will be represented by the fraction 2/2 or 
one hundred percent. Тһе satisfaction of an indi- 
vidual with a plus score of 1, will be represent- 
ed by the fraction 1/2 or fifty percent. 

The reader should further note that each indi- 
vidual's total response is here represented by an 
average which is secured by dividing the sum of 
the scores by the number of responses. If the 
average is numerically less than 3 it is interpre- 
ted as a satisfaction score. If it is more than 
3, it is treated as a.negative score, and theper- 
centages.are.-inte: accordingly. Possibly 
attention aga&peshowldibe called to the fact that 

H те ox-minus score may arise from 
i&trong ft the bout a relatively few items. The 
balance тау be-changed from plus to minus ог 


minus to plus by a few of these items when the 
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TABLE VIII 


RAW SCORES OBTAINED FROM INVENTORY (WORK SHEET) 


JOURNAL OF EXPERIMENTAL EDUCATION 


858 


310 


+72 


2.77 


uontsod reponaed. 
0} parejas SW! Jo "ON XI 


а! 


15 


18 
за 


91 


36 


17 


2.53 


(b) 


(a) 


squapnys 
от paiv[o1 sura]! Jo ‘ом IIIA 


$3 


24 


19 


2.21 


випокі 
о} раццал sto Jo ‘ом 
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15 


15 
12 


30 


12 
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45 


31 


2.31 
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(b) 
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16 
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20 


10 


39 


112 


2.87 


12 


24 


12 


18 


35 


19 


1.94 
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(b) 


(а) 


16 


60-15 


1 
15 


-14 


35 


32 


115 


-19 


3.59 


(b) 
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30 
32 
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3.29 
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(b)** 


(а)* 


20 


10 


10 


14 


28 


14 


24 


72 
28 


75 


15 


-30 


antea оплдайру 


+2 


“1 


-2 


anpra паша 


70 


responded to: 
Total weighted 


Total items 


213 


score 
Total original 


score 


3.04 


Mean 


* (a) Weighted scores 
**(b) Algebraic scores 
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individual's score is по already too heavily 
weighted one way or the other. 

The teachers responded with variable degrees 
of satisfaction-dissatisfaction to their situations 
in general as indicated in Table X. The means 
of the teachers' responses to the total situation 
Column (Yo), indicates that five teachers, num- 
bers 7, 11, 15, 17, and 26 were more dissatis- 
fied than satisfied with their situations. The as- 
pects of the situation with which all members of 
this group showed more dissatisfaction than sat- 
isfaction included the students, the people of the 
community, and the school organization. One 
teacher indicated dissatisfaction with all nine 
aspects; the one showing least dissatisfaction 
was dissatisfied with six of the nine aspects. 

Sixteen of the respondees indicated satisfac- 
tion with each of the nine aspects of the situation, 
while 24 who indicated satisfaction recorded dis- 
satisfaction with one or more of the nine aspects 
of their situations. 

As one examines these data it appears that 
teachers feel more satisfied with some aspects 
of the situations than others, and some teachers 
are more generally satisfied than others with 
the situation. 

The means of the responses to the nine cate- 
gories indicate that on the average more teach- 
ers were satisfied than dissatisfied withallnine 
categories. Тһе rank order in which the teach- 
ers indicated most satisfaction with aspects of 
the situation are as follows: (1) administrative 
personnel and procedures, (2) faculty, (3) the 
particular position in which the teacher is, (4) 
the school organization, (5) the community in 
general, (6) instructional materials, (7) school 
plant, (8) the people of the community, and (9) 
the students. They were least satisfied with stu- 
dents. 

А summary of each of the above nine cate- 
gories follows. When percents are spoken of 
they were calculated by the process already indi- 
cated above. 


1. The Administration 


Nerd analysis of the teachers' responses to in- 
аер. items of the Inventory related to Ше ad- 
ES Es ration (Table XI), shows that the teachers 
satista? indicated more dissatisfaction than 
age ош with no aspect of administration. 
cent Ps өзені which were satisfactory to 50 per- 
ing of th е teachers or more include the stand- 
е age и Board of Education in the community, 
the A eee experience and philosophy of 
from 28 t, ntendent. All other items ranged 
© 50 percent in satisfaction. 


2. The Faculty 


The ; 
analysis of the teachers' responses to 
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the individual items oí the Inventory related to 
the faculty of the school (Table XI) having a rel- 
atively high degree of satisfaction were the aver- 
age age of the faculty, the number of Wisconsin 
Education Association memberships, and the a- 
vailability of group insurance. А lower degree 
of satisfaction was registered for the personper- 
forming, the method used in performing, andthe 
purpose and basis used in the evaluation of the 
work of the faculty. These scores in the afore- 
named items ranged from 2 to 40 percent. Inthe 
same range of satisfaction were the number of 
faculty assistants available, andthe type and com- 
petence of the help provided. Actual dissatisfac- 
tion was registered with regard to the adequacy 
of the professional library and the number of ar- 
ticles published by the members of the faculty. 


3. The Particular Position 


The analysis of the teachers’ responses to in- 
dividual items of the Inventory related to the par- 
ticular position (Table XI), indicate a high degree 
of satisfaction with the degree of independence al- 
lowed and frequency of payment of salary these 
being given 82 and 74 percent satisfaction scores 
respectively. A general lower degree of satis - 
faction was registered for such aspects of the 
position as the size of the classes and the num- 
ber of activities and the appropriateness of train- 
ing to handle extra curricular activities. There 
was no item for which the number of teachers 
dissatisfied with the situation exceeded the num- 
ber satisfied. 


4. The School Organization 


The analysis of the teachers’ responses to in- 
dividual items of the inventory related to the 
school organization (Table XI) shows that a high 
degree of satisfaction, ranging from 50 to 85per- 
cent, was indicated for the hour of opening and 
closing school, length of class periods and the 
noon hour, and the vacation periods allowed. With- 
in this range, the type of grading system used 
received the highest degree of satisfaction of all 
of the items on school organization. The import- 
ance of the grading system to the pupils, the aids 
available to teachers for the guidance of students, 
the value of participating in teacher m e е{їп 5, 
and Ше adequacy of the school library in all 
areas received the lowest degrees of satisfaction, 
ranging from 1 to 5 percent, Other items of the 
Inventory in relation to the school organization 
that the teachers rated low in satisfaction we re 
the rigid use of a fixed marking system, narrow- 
ness and inadequacy of course offerings to meet 
the student's needs, and the type and amount of 
guidance provided. Still others in this same cat 
egory were the frequency, method of planning an 
the value of school assemblies. Low degrees of 
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TABLE XI 


SELECTED ITEMS FROM THE TEACHFR SITUATION INVENTORY INDICATING THE PERCENT AND | 
REASONS FOR SATISFACTION-DISSATISFACTION 


SECTION I: THE COMMUNITY 
Percent 1. COMMUNITY LOCATION 


" | 
The State it is in: Е 
Prefer to teach in home State. Like to live in warmer climate. 

Section of the State it is in: 


Like to be near large city. Prefer to be in Southern part of State. 


2. SIZE OF COMMUNITY 


The Population 
36.5 Prefer to live in larger cities. 
3. COMMUNITY ACCESSIBILITY 
Adequacy, Condition of Highways 
53.5 


Good roads were generally available. 
repair. 


Some need of road and Street 


| 
Convenience of Bus Schedules 
Poor bus schedules. 


Convenience of Train Schedules 
No convenient train Schedules. 


-26.5 


4. ADJACENCY OF COMMUNITY 


Nearness to Shopping Centers | 
Near good shopping centers. 
| 


9. GEOGRAPHY OF THE COMMUNITY 


Its Topography 
Like the lakes, woods and hills. 


Its Cleanliness 
61.0 — 


Most towns and cities are kept very clean, some need to get funds to 


6. COMMUNITY APPEARANCE | 
make improvements. 


7. INDUSTRIES OF THE COMMUNITY 


Their Contribution to Progress 


Industry helps the cities. Need more interest by all people in com- 
munity planning. 


2 
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8. COMMUNITY INSTITUTIONS 


The Diversity of Churches 
Adequate to numerous. 


Activity of the Churches 
Very active to passive. Should coordinate activities of church with 
School. 


Availability of Your Denomination 
Not always available. 


9. COMMUNITY HEALTH SERVICES 
Availability of Good Doctors 
Available for the most part, some communities need more doctors. 


Availability of Good Dentists 
Adequate to fair. 
10. PUBLIC LIBRARY 


Its Convenience of Opening Hours 
No library, poor that are available, poor schedule, poor service. 


Its Adequacy of Materials 
Materials not adequate. 


12. SOCIAL GROUPS, COMMUNITY CLUBS 
Their Diversity 
Many and varied; need more social groups for young people. 


Their Purposes for Organization 
Have social purposes by and large; need wider aims. 


Their Availability to Teachers 
Easily available; teachers can attend but not overly encouraged by the 
community. 


Their Contribution to Community 
Some have purposes; others purely social. 


13. LIVING QUARTERS IN COMMUNITY 
The Type You Found Available 
Private homes, rooms, apartments. 


The Suitability of its Location 
Generally suitably located close to school. 


The Modernness of Its Conveniences 
Very modern. 


The Restrictions, Regulations Asked 
Few to no restrictions. 


The Degree of Privacy Provided | 
АП that can be desired; some need privacy. 
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14. MEAL ACCOMMODATIONS 
The Convenience of Location 


Good to excellent; walking distance from school. 


17. CULTURAL OPPORTUNITIES IN COMMUNITY 
Its Stage and Concert Offerings 


Extreme lack of concerts, plays. 
obtaining of it in the community. 


Need community interest to back the 


Its Museums, Galleries, Zoos 
Non-existent. 


Its Public Forums and Lectures 


None to moderate, offered by nearby institutions. Television coming 
in. 


Its Provision for Adult Education 


Agriculture, homemaking, vocational schools, more courses should 
be offered. 


18. LEISURE TIME OPPORTUNITIES 


Commercial Amusements Available 
General run of movies, bowling. 


19. EXTRA JOB OPPORTUNITIES 
Types of Extra Employment Available 


None to part-time work. More small businesses needed. 


21. COMMUNITY DEMANDS ON TEACHERS 
Community Responsibilities 


и left comparatively Íree, people recognize demands, teacher 
oad. 


Social Taboos, Bans on Behavior 
Most anything within reason, very liberal. 


Expectancies of Residence 
Can leave for weekends, free to come and go. 


SECTION II: PEOPLE OF THE COMMUNITY 


2. LANGUAGE OF THE PEOPLE 
The Quality of Everyday Usage 


Low level of English spoken generally, 


poor gram ti 
change attitude of people toward language. е MAE usage, DOMI 


5. PEOPLE'S CULTURE 
Their General Educational Level 
Educational level is low. 


Their Interests in the Arts 


Very little interest, people not interested in finer things of life. Need 
clubs, churches that would build this up. 


50. 


-37. 


43. 
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7. CHARACTERISTICS OF THE PEOPLE 
Their Hospitality 
Extremely friendly generally; should make new teacher more welcome. 


Their Friendliness 
-y Good, congenial and helpful. 


Their Cooperation with the School 
Excellent to take school for granted. 


Their Pride in Home and Community | 
Takes pride in immediate community; not the wide community. 


SECTION Ш: SCHOOL PLANT 


1. SITE OF SCHOOL PLANT 
Its Convenience of Location 
Most generally centrally located within walking distance. 


Its Adequacy of Playground 
Good to small, traffic hazards, more space generally needed. 


Its Appearance of Grounds 
Good generally, playgrounds need repair. 


3. HEATING OF THE BUILDING 
The Type in Use 
Good, usually warm, well controlled. 


4. LIGHTING IN THE BUILDING 
The Type in Use 


Mostly direct, single lights. 


The Adequacy of Performance 
Excellent to very poor. Halls need light. 


The Convenience for Use 
Good, to fair, to lack of proper outlets. 


9. FACULTY ROOMS 

The Number of Them 
No faculty room; need some room for faculty privacy. Felt the need 
of this very strongly. 


The Degree of Privacy АНогаеа 
No privacy, boiler room only place to take а smoke and relax. 


The Regulations for Their Use 
Not many regulations, can't smoke in some; poor furniture in them. 


10. CUSTODIAL SERVICE 


equac 
Hs Асан excellent to fairly adequate, lax, uncooperative janitors. Should be 


more conscientious. 
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Its Competency 
Very good to very little done, rooms not kept clean, too old men. 


Its Cooperativeness with Faculty 
Hold the efficient ones and get rid of the uncooperative ones. 


SECTION IV: THE ADMINISTRATION 


1. THE BOARD OF EDUCATION 
Its Standing in the Community 
Well liked, looked up to, respected, good. 


Its Educational Philosophy 


Conservative to progressive to let alone policy. 
derstand problems. 


Need people who un- 


3. THE SUPERINTENDENT 
His Age 


Mature in judgments; 35 to 60 years old. 


His Years in Present Position 
From 2 to 25 years. 


His Years Training and Degrees 
Sufficient, Masters to Ph. D.’s, mostly Master’s degrees. 


His Kind and Amount of Experience 
Wide experience, range of 6 to 35 years experience. 


His Educational Philosophy 
Conservative to progressive; 
philosophy needed. 


greater dignity in his actions. Broader 


6. ADMINISTRATIVE POLICIES 
Standards for Student Promotion 


No failing policy; 
standards for pro 


level of scholarship should be improved; definite 
motion should be set and maintained. 


Standards for Student Eligibility 
Poor students passed so they can make the team; WIAA standards. 


Teacher Experimentation, Research 
Given considerable leeway; up to individu: 
is discipline; often encouraged. 


al teacher so long as there 


Teacher Tenure, Seniority Rights 
Fair to good. 


Use of Democratic Procedures 
Administrator makes final decisions; te 
suggestions; student's through council h: 
Should make democratic procedure sinc 


achers encouraged to make 
ave part in decision making; 
ere; lack of faculty planning. 


SECTION V: SCHOOL ORGANIZATION 


1. THE SCHOOL YEAR 
The Vacations Allowed 


Se — 
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Christmas and spring. 


2. DAILY SESSIONS 
The Hour of Opening 
Range of 7:55 A. M. to 8:55 A. M. 


The Length of Periods 
Range of 43 to 60 minutes; prefer periods of varied length for differ- 


ent groups. 


The Length of Noon Hours 
Range of 30 minutes to 1-1/2 hours. 


Тһе Hour of Closing 
Range between 3:30 P.M. to 4:30 P.M. Prefer 3:30 to 3:45. 


3. SCHOOL GRADING SYSTEM 
The Type Used 
Letter grade A, B, E, D, F. More flexibility in grading systems. 


The Rigidity of Its Use 
Very rigid. 


The Importance it Holds with Pupils : 
Pupils do not pay too much attention to it; know they won't fail. Other 
pupils put too much emphasis on grades. 


4. SCHOOL CURRICULUM 

The Broadness of Offerings 
Very little to many choices possible. No languages offered. Commer- 
cial and shop courses needed. 


Its Adequacy for Student Needs 
Course offerings needed to meet the need in Agriculture, Shop, Home 
Economics. 


Its Requirements and Electives 
Not enough electives. 


5. SCHOOL EXTRA-CURRICULUM 

The Diversity, Variety of Offerings 
Many activities offered such as Music, Speech, Athletics and many 
others. 


The Adequacy for Student Needs 
Does not take care of the needs of all students. Rural students not 
able to participate. 


The Balance Among Activities 
Too much emphasis on sports, Agriculture and Music. Need balance. 


6. STUDENT GROUPING IN SCHOOL 


The Bases Used to Group | 
ТО. performance; grade level plus much guesswork. Need ability 


grouping. 
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Тһе Purposes for Doing It 
Е To make it easy to locate students; allow good students to progress. 


". STUDENT CONTROL 

The Type Used in Whole School 
Student council; purposes of student council not clearly defined. Estab- 
lish policy on role of student council and furnish good guidance for it. 


The Nature of Regulations Imposed 


No set rules. Rules should be made by teachers, pupils and adminis- 
tration. 


8. SCHOOL ASSEMBLIES 
Their Frequency 


Once or twice a month, not often enou 


gh, more planning needed by all 
concerned. 


Their Purpose 


For giving directions, instruction and recreation. Goals shouldbe set 
with students in mind. 


Their Value to the Students 
Some excellent, others a waste of time. 


The Responsibility for Organizing 


Principal plans most, students and teachers others. Should be coop- 
erative effort. 


9. SCHOOL GUIDANCE OF STUDENTS 
The Type and Amount Provided 
em amount Provided 


Need of guidance director; mostly done by teachers. 


The Aids Available to Teachers 


Few to none provided. Need for material such as occupational infor- 
mation. 


11. TEACHERS MEETINGS 
Their Frequency 


Formal and does not accomplish much. Two meetings a month. Need 
more well planned meetings. 
Their Purpose 


Discuss school problems, that could be taken care of in other ways. 
Teachers wont express themselves freely 


Their Procedure 
— Semi-democratic, more teacher participation needed. 


The Value to Participants 


One person gets the floor and keeps it. 


Those not directly con- 
cerned should be excused. Absolutely of no value. 


SECTION VI: INSTRUCTIONAL MATERIALS 


1. SCHOOL LIBRARY 
Its Size and Number of References 
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Restricted facilities to very good facilities. Library improvement 
program should be set up. 


Its Adequacy for all Areas 
Limited in some fields, need source books in Literature and Social 


Sciences. 


Its Recency of Books and Materials 
Books are too old. Need fresh materials. 


Its Variety and Range of Difficulty 
Should have books for ranges of ability. 


Its Suitability of Periodicals 
Excellent to very limited selection. Need a variety in a central place. 


2. AUDIO-VISUAL MATERIALS 
Their Appropriateness 
Service available, average use is made of it. 


Their Condition, Ease of Operation 
Excellent, average, good to never works right. 


` 


Тһе Regulations for Use 
Not strict, must sign schedule. 


The Budget for Materials 
Not enough money to unlimited. 


3. TEXT MATERIALS 
The Quantity Furnished 
Not sufficient, limited; all new books. 


Their Ownership 
Furnished by school. 


Their Appropriateness 
Generally out of date and not enough range of difficulty. 


Their Condition, Worn, etc. 
Cheap, worn, to good to excellent. 


4. CLASSROOM AIDS—LABORATORY 
The Equipment Furnished 
Could use more. From poor to fair to good and better than average. 


Their Adequacy, Number and Size 
From not enough, to average to excellent. 


Their Condition 
Poor, to good, to excellent. 


5. STANDARDIZED ТЕ5Т MATERIALS 


xtent of Use й | 
The Erlen Testing program in operation; left up to teachers. 
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The Purposes of Administration 
For classification, diagnosis and placement; no one Seems to know. 


6. SUPPLEMENTARY MATERIALS 
Provision for Field Trips 


School buses available at times; field trips should be used more by 
teachers. 


Provision for Outside Talent 


Some through University of Wisconsin. Provision should be made for 
at least limited program. 


SECTION VII: THE FACULTY 


1. STRUCTURE OF FACULTY 
Total Number of Individuals 


Range of 5 to 62. 


The Average Age 
35 years; would prefer younger people to work with. 


Their Age Range 
Range of 21 to 60. 


The Sex Distribution 
50 - 50 to too many women. 


Their Marital Status 


Most men married, women single. Either more single men or none. 


4. RESIDENCE OF FACULTY 
The Percent Living Out of Town 


20 to 25% live out of town. 
munity. 


Should live in town and ав part of com- 


The Percent of Home Teachers 
From none to 85%. 


6. FACULTY PROFESSIONAL STATUS 
The Number of WEA Memberships 


Twenty-five teachers reported 100% in WEA. 


The Number of Union Memberships 
None. 


The Number of Earned Recognitions 
None to few, if any. 


The Number Having Articles Published 
None, few, 2 or 3. 


7. ASSISTANTS TO FACULTY 

The Number Available 
None to one who is overworked. Nee 
time when faculty could call on help. 


d more faculty help. Have a 
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The Type of Help Provided 
Student help. 


The Competence of the Help 
Poor to very competent, very willing to help. 


8. SERVICES TO FACULTY 
Availability of Group Insurance 
Largely Blue Cross. 


Provisions for Sick Leave 
Average 5 days. 


Rules on Emergency Leave 
Very reasonable and liberal and understanding. 


Adequacy of Professional Library 
From good, adequate to very poor. Need material which relates to 


School problems. 


9. SELECTION OF FACULTY 
The Method Used 
Personal interview with superintendent. 


The Bases for Choice 
Qualifications, personality and recommendations. 


10. EVALUATION OF WORK OF FACULTY 

The Method of Evaluation Used 
None that is known; principal visits classroom; informal; not informed 
how teachers were evaluated. 


The Purpose for It 
Merit system; improve quality of faculty; promotion and raises. 


The Bases Used in Evaluating 
Educational theory; experience, or impressions of principal. Prefer 
teacher would be informed of basis of evaluation. Valuations could 
be more specific to help the teacher. 


Curricular worker, principal, superintendent, supervisor. 


SECTION VII: THE STUDENTS 


1. STUDENT ENROLLMENT 


The Total Number 
— — 85 to 1600. 


The Majority Sex 
— — About equal. 


-Pupil Ratio 
The Teacher ог to 25 to 35 pupils. Prefer smaller groups of 20 to 25. 
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2. STUDENT RESIDENCES 
The Distance from School | 
Some come as Таг as 40 miles, too long bus ride. 


Bus routes are too 
long. 


The Condition of the Homes 
Poor, good, very comfortable. 


3. STUDENT PERFORMANCE 
The Persistency of Attendance 


Too many absences, need close check. Classes Should be made more 
interesting so students would be eager to attend. 


The Level of Scholarship 


Generally low, few real Students, no apparent ambition, little self di- 
rection. Great need for conscientious study. 


4. STUDENTS’ TRAITS 
Their Behavior, Manners 


Well mannered to rude, uncouth. Students show lack of home training. 
Parents should teach children manners. 


5. STUDENT ATTITUDES 
Those Toward Fellow Students 


Generally good to too many Cliques. Little concern for other students’ 
feelings. Could be improved with right leadership. 


Those Toward Learning 


No desire fo learn, attend because they have to. 
vate to arouse desire for learning. 


Teacher must moti- 


Those Toward Faculty 
at Faculty 


Good, to more respect needed, teacher can’t let down for a minute. 


6. STUDENT CONTRIBUTIONS 
Percent Going to College 


percent to 30 percent. Need to stress importance of education. 


SECTION IX: THE PARTICULAR POSITION 
1. YOUR TEACHING LOAD 


The Appropriateness to Your Training 
Good, very good, excellent. 


The Number of Classes 
Average 5 per day. 


The Size of the Classes 


Most generally too large, range 14 to 40, prefer 20 to 25, 


2. YOUR EXTRA-CURRICULAR LOAD 
The Number of Activities 


Average of two. Some teachers carry too heavy a load in this area. 


—- 
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The Appropriateness to Your Training 
Wide training should be required to handle various activities. Prefer 


student council training, pep club. 


3. YOUR ADMINISTRATIVE LOAD 
Amount of Home Room Responsibilities 


Home room, detention hour. Need to be organized and planned. 


Number of Noon-After School Duties 
Noon duty, supervise school social functions, playground. Such work 
is distributed among teachers. Would prefer to have it distributed 


fairly. 


The Number of Records and Reports 
Just grades, 4 to 5 reports of various kinds a month. 


The Times Lesson Plans are Required 
None, checked every week, recommended by supervisor. Prefer not 


to have to submit them in too much detail. 


The Degree of Independence Allowed 


The Amount 


Very much on your own. 


4. YOUR INSTRUCTIONAL MATERIALS 


The Appropriateness of Other Aids 
Should be more suitable; more maps, references and periodicals need- 


ed. Less difficult material needed for students of less ability. 


5. YOUR COMMUNITY DUTIES 


Their Nature 


None. Entirely voluntary, exhibits, talks P. T. A. 


6. YOUR SALARY 


Generally ranged from $2400 to $3450. Would prefer from $2600 to 
$3600. 


The Frequency of Payment 
Generally once a month. Choice of 9 to 12 months. Prefer two times 


per month. 


The Bases for Determining 
No basis. Salary schedule. Experience and training. Prefer single 


schedule. 


The Number of Deductions 
Health insurance, retirement, income tax. Prefer less deduction for 


retirement. 


1. YOUR CONTRACT PROVISIONS 


Their Exact Nature 


None to very exact. Extra curricular duties not specified. Prefer to 
have more stated exactly what one must do. 


Their Justness 


Generally very fair. 
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8. YOUR PROMOTION 
The Form it Would Take, its Nature 


Raise in salary. 


The Basis for Granting 


Experience, competent performance, extra-curricular work. Based 
too much on discipline. 


The Amount of Salary Increments 


Range of $100 to $325 а уеаг. 


Prefer set Salary schedule soallteach- 
ег5 will know. 


9. FURTHER REQUIREMENTS 
The Teaching Method Desired 
Left up largely to the individual teacher. p 


rincipal desires teacher 
control students. Prefer more Supervision 


- More pupil planning. 
The Student Relations Desired 
Friendly but keep proper professional distance. 


The Type of Discipline Wanted 


Up to the individual teacher. Prefer more administrative backing. 


The Committee Work Involved 


Voluntary basis. Many committees working continually on problems 
and research. 


December, 1956) 


Satisfaction were indicated for such itemsas Ше 
Importance of the grading system to the pupils, 
Occupational information available, the guidance 
of Students, and the value of teacher meetings to 
the Participants. There were no items of the 
School organization that received more dissat- 
isfaction responses than satisfaction responses. 


5. The Community 


| Тһе analysis of the teachers' responses to in- 
dividual items of the Inventory related to the com- 
munity (Table ХІ) indicate some dissatisfaction 
with convenience of bus and train travel, cultur- 
al Opportunity, leisure time opportunity, and ex- 
tra job Opportunities. Those aspects of the com- 
Munity toward which the teachers indicateda 
high degree of satisfaction (75 percent or higher) 
Were the state in which they taught, accessibili- 
іу of living quarters, moderness of living quar- 
ters and the paucity of restrictions in their liv- 
Ing quarters, 


6. The Instructional Materials 


Ра. analysis of the teachers' responses to in- 
hrs à items of the Inventory related to the in- 
E ies lonal materials (Table XI) indicated a rel- 
Е ely low degree of satisfactions with the 
erp ropriateness of supplementary aids to teach- 
tion They indicated that there was a need for 
кез е suitable aids such as maps, charts, refer- 
{ 95, and periodicals. There was also need 
ОГ graded material of various reading difficulty 
50 аз to meet the needs of all the Students more 
adequately, according to the teachers respond- 
Ing to the inventory. 


7. The School Plant 


. The analysis of the teachers' responses to in- 
dividual items of the Inventory related to the 
School plant (Table XI) shows some high degrees 
ОЇ dissatisfaction. Those items which received 
igh dissatisfaction scores (ranging from 18.0 to 
743.5 регсепі) were Ше lack of a faculty room 
ІП which to have some privacy, and the restric- 

1018 placed оп the use of a faculty room where 

“re was one. The items which received high 
Satisfaction scores were the location of the 
School Plant, the heating of the building, the con- 
venience of light, and the appearance of the play- 
аца, Lower satisfaction scores were indi- 

ted tor the inadequacy of the playground, the 
a De of lighting used, insufficient light for halls 
суд ITWays, and the inadequacy, incompeten- 
The nd uncooperativeness of custodial aa vice. 
to as. lower satisfaction scores ranged from 
Percent. 
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3. The People of the Community 


The analysis of the teachers’ responses to the 
individual items of the Inventory related to the 
people of the community (Table XI) indicates dis- 
satisfaction with the people of the comm unity 
with respect to their language usage, educational 
level, and interest in the arts. The friendliness 
and hospitality of the people were given 61 per- 
cent and 60 percent satisfaction scores, respec- 
tively. 


9. The Students 


The analysis of the teachers’ responses to in- 
dividual items of the Inventory related to the stu- 
dents (Table XI) indicates a generally low degree 
of satisfaction or a moderately low dissatisfac- 
tion with the various aspects relative to students’ 
performance, attendance, level of scholarship, 
attitude toward learning, and the distance of p u- 
pils from school as the latter affects the various 
aspects of the students’ school life. These items 
had a range of -4.5 to -15.0 percent of dissatis- 
faction. The low satisfaction scores were indi- 
cated іп the areas of personal traits and manners 
of the students, suchas behavior and manners, at- 
titudes toward faculty members and fellow stu- 
dents, and the conditions of the homes. 


Analysis of the Responses of the Fifteen Most 
Satisfied and Dissatisfied Subjects 


A study was also made of the relation between 
satisfaction-dissatisfaction scores and teacher 
efficiency as determined by supervisory ratings. 
Three criteria of efficiency were employed: (1) 
an Acceptability rating, (2) an M-Blank rating, 
and (3) a Composite of Various Measures. The 
satisfaction-dissatisfaction scores previously re- 
ported in Table X, were arranged in rank order 
(see Appendix B-2, B-3 and B-4 for the raw da- 
ta). The most dissatisfied teacher, i.e., the 
teacher with the highest raw score, was given 
rank order one. This was done separately for 
each category. The least dissatisfied teacher, 
1.е., the teacher with the lowest raw score, was 
ranked forty-fifth. A summary of thesescores 
is given in Tables XII, XIII, and XIV. 

From examining the data in Tables XII, XIII, 
and XIV, it may be noted that no consistent pat- 
tern is revealed. The mean scores of the15most 
dissatisfied and the 15 least dissatisfied teach- 
ers in relation to the acceptability criterion 
showed that the 15-most dissatisfied teachers re- 
ceived a more favorable mean efficiency rating. 
In relation to the Composite (Xo) criterion the fif- 
teen most dissatisfied teachers also receiveda 
more favorable mean efficiency rating. In rela- 
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De to the M-Blank criterion the fifteen most 
to im teachers received a less favo rable 
efficiency rating. It should be noted that there 
is much inconsistency among the various individ- 
uals that constitute the two groups. 
не оне чоша ordinarily assume Ша! inasmuch 
zoe аа поле, by and large, in Ше sm aller 
Schools are not as satisfactory as in larger 
ШШЕ S (certainly with respect to the p hy sical 
c materials of instruction and in some in- 
on Et the character of the pupils) that tea c h- 
нянні smaller schools would show more dissat- 
ВЕН, than teachers іп larger schools. This 
eem ion is borne out by the data in Table XIVa. 
ton и, the teachers almost without ехсер- 
isfied th e smaller communities aremore dissat- 
peche an teachers in the larger communities. 
тесеу пау half of these teachers (7 out of 15) 
iode ed higher efficiency ratings than the teach- 
dem larger communities. 
LS is in accordance with expectation inas- 
io XR there are certain things with respect 
welll good teachers showed dissatisfactionas 
as poor teachers. 


Correlational Analysis 


Cae analysis of the data was made 
lations use of correlational techniques. Corre- 
of Table ху calculated between the categories 
range fr У and teacher efficiency. These 
zero Sen, -.06 to + .41; a number were near 
a positi rom these data it appears that there is 
iency xA relationship between teacher effic- 
munit nd the sort of people that make up Ше com- 
tween: There is also a positive correlation be- 
ment не ion X1, which is the State Depart- 
ation ating, and between all aspects of the situ- 
У ов Criterion X4 which was Montross' cri- 
к е The highest positive correlations are be- 
ки the School Organization Ү5, Instructional 
Сев Y6, The Faculty Y7, Mean Total Yo, 
indicas and X4. The low and zero correlations 
soe со Felatipnship: It should be noted that 
indicati the relationships are negative, e. 8-,— 
S oen that high dissatisfaction in some in- 
Gere associated with efficiency. | 
Certain с ations between the M-Blank ratings and 
Supports ategories were among the highest. This 
most m of the earlier findings wherein the 
9rable oes teachers received less fav- 
istieg, Мо Blank ratings than the 15 least dissat- 
iency b Е. gain a better understanding of effic- 
he Subjects x the M-Blank and responses of all 
ti обе - to the four categories in which posi- 
lation sel ations were found, the multiple corre- 
Siven і hnique was applied and the results аге 
ks Table XVa. 
tive] 4 be noted in this connection, that rela- 
between Eh positive intercorrelations (ranging 
- 59 and . 83) were found between the cat- 
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egories pertaining to the students and school or- 
ganization, students and instructional materials 
students and faculty, faculty and school organiza- 
tion, and instructional materials and school o r- 
ganization. These high intercorrelations would 
appear to indicate that teachers tended to re- 
spond to the various categories listed witha gen- 
eralized attitude of satisfaction or dissatisfac- 
tion, and thatthis generalized attitude was re- 
flected in efficiency ratings received on the M- 
Blank to a certain extent. The multiple correla- 
tion obtained between the M-Blank ratings and 
the responses to the four categories was 0. 43. 


Analysis of Responses of the Interviewed Sample 


A further study was made of the fifteen sub- 
jects who had not returned the inventory. They 
were interviewed to obtain their reactions to se- 
lected aspects of their situations. 

After rapport had been established they were 
asked the following questions: 


1. With what aspects of the community would 
you approve or disapprove? 

2. What aspects of the people of the community 
would you approve or disapprove? 

3. What aspects of the school plant would you 
approve or disapprove? 

4. With what aspects of the administration would 
you approve or disapprove? 

5. With what aspects of the school organiza t i on 
would you approve or disapprove? 

6. With what aspects of the instructional mate- 
rials would you approve or disapprove? 

7. With what aspects of the faculty would you ap- 
prove or disapprove? 

8. With what aspects of the stüdent body would 
you approve or disapprove? 

9. With what aspects of the particular position 
would you approve or disapprove? 


For those items in each category to which the 
subject responded where satisfaction was ех- 
pressed, a value of plus 1 was assigne d; For 
those items to which the subject responded with 
dissatisfaction, a value of minus 1 was assigned. 
When the subject neither approved nor disap- 
proved, a zero value was assigned. Satisfaction- 
dissatisfaction scores were computed for this 
three-point scale and the responses conve rted 
into a percent of satisfaction-dissatisfaction. 

The individual responses to the selected items 
of the Inventory are given in Appendix B-5. ў А 
summary of the responses of the fifteen subjects 


are given in Table XVI. This table 5 hows ше 
sum of Ше approval, neutral, and disapproval 
responses for each category; and the mean par 
cent of satisfaction-dissatisfaction for ig i 
teen subjects’ response to this category. 

The sae order in which the sample of fifteen 
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responded to the nine categories and the rank 
Order in which the original group of forty-five 
responded are presented in Table XVII. 

From inspection of the table it may be noted 
that the rank order of the mean responses of the 
fifteen Subjects interviewed was identical with 
the original forty-five with respect to five cate- 
Bories: The Students, The People of the Com- 
munity, The Community, The Particular Situa- 
Поп, and The Administration. Rank orders dif- 
fered by 1 or 2 with respect to Instructional Ma- 
terials, the Faculty, and the School Organiza- 
lion. A wide difference was found, however, 
With respect to the two groups' responses to the 
School plant. In general, the responses of those 
interviewed did not differ markedly from those 
filling out the Inventory. Those interviewed, 

Owever, rated all categories of the environment 
less satisfactory than did the original group. 


Analysis of Case Studies 


~ Ten case studies are here presented, which 
include the five most satisfied teachers and the 
five most dissatisfied teachers. One dissatisfied 
teacher was omitted because of the insufficiency 
9f data available. 

Each case study is presented in two parts а 
Тһе first part presents general information ге `- 
ative to such items as age, sex, marital status, 
family data, parents' education, parents’ occu- | 
Pation, teacher preparation, number of differen 
Schools attended, degree of self support, jobs 


eld for ра ins taken, veteran, 
y, number of trips еп, 
and experience in youth leadership. The Less 


Part summarizes each subject's responses 10 
various categories of the Inventory (Appendix 
71). In this part of the case study, the majan 
Sources of satisfaction or dissatisfaction ar 
identified, the mean efficiency rating is repor id 
ed, and the relationship between satisfaction an 


efficiency rating indicated. 
SUBJECT NUMBER 21 


The analysis of the subject's responses to the 
various items of the Inventory (Table X) epp 
m Satisfaction was expressed with such îr З 
Ччепсу and with such degrees of intensity as (0 
саке а generally positive response. ран 
sal percent of satisfaction is 76.5. In t ido 
ense this teacher is the most satisfied of t| 
Thee of teachers studied in this и 
ed four categories to which the subject respond- 
та ith the most satisfaction were the XP =. 
ane 97.0 percent; the school plant, 97-4 Ре 
and t the instructional materials, 95-5 parem 5 
ге he school organization, 89. 5 percen ша 
subject to the administration (Appendix B-1) 
to Ject responded in a highly favorable degree 
all items, including the board of education, 
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the accreditation of the school, and the superin- 
tendent. Satisfaction was also registered for 
standards of student promotion and use of demo- 
cratic procedures. The items of the school plant to 
which the subject responded in a highly favorable 
degree were the site of the school plant; the 
school building and floors; hearing; lighting; 
rooms in the building; toilet facilities; furniture; 
faculty rooms; and the adequacy, competency 
and cooperativeness of custodial service. There 
were no items of the school plant to which the 
subject responded in any degree of dissatisfac- 
n. 
m This subject received a composite efficiency 
rating (Xo) of 2. 75, which is slightly above aver- 
age. This teacher ranked 28.5 from the top in 
the group of forty-five teachers. 


SUBJECT NUMBER 13 


The analysis of Ше subject's responses to Ше 
various items of the Inventory (Table X) shows 
that satisfaction was expressed with such frequen- 
cy and with such degrees of intensity as to indi- 
cate a generally positive response. The mean 
total percent of satisfaction is 73.5. The five 
categories to which the subject responded with 
the most satisfaction were: the instructional ma- 
terials, 92. 0 percent; the students, 91.0 percent; 
the particular position, 91. 0 percent; the school 
organization, 83.5 percent, and the faculty, 78.5 
percent. The items in regard to the instruction- 
al material (Appendix B-1) to which the subject 
responded in a highly favorable degree were, all 
items in regard to the school library, audio-vis- 
ual materials, text materials, aids for class- 
room and laboratory, and standardized test ma- 
terials. Satisfaction was also registered with 
reference to provisions for field trips and out- 
side talent. There were no items of the instruc- 
tional materials to which the subject responded 
with dissatisfaction. The items in regard to the 
students to which the subject responded ina high- 
ly favorable degree were student enrollment, stu- 
dent residences and the performance of students 
in respect to attendance, level of scholarship, 
extra-curricular participation, extent of com - 
munity activity, extent of social activities and 
percent employed. Satisfaction was also regis- 
tered with reference to behavior, loyalty, school 
pride, cooperation andfriendliness, as was sat- 
isfaction registered for student attitudes toward 
fellow students, faculty, and rival schools. The 
percent going to college was also given a favor- 
able response. There were no items with refer- 
ence to students to which the subject responded 
with dissatisfaction. 

The subject received а composite effi с- 
iency rating (Хо) of 2.00 which places him 
12th in the whole group of forty-five. 
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TABLE XVI 


SUMMARY OF THE RESPONSES OF THE FIFTEEN SUBJECTS OF THE INTERVIEW 


€, 
Situations P % о N % 
1. Тһе Community 
— ——ommunity 
With what aspects of the 
Community would you 
approve or disapprove? 
а) State 12 80 0 3 20 
b) Accessibility 6 40 0 9 60 
C) Cleanliness 8 53 0 7 4T 
d) Church groups 9 60 6 0 0 
е) Library 4 27 0 11 73 
Í) Health services 8 53 0 7 47 
g) Social groups 1 47 0 8 53 
h) Living quarters 9 60 0 6 40 
i) Cultural Opportunities 4 27 0 11 73 
Total 67 440 6 62 413 
Меап 52 48 
Il. People of the Community 
With what aspects of the 
people of the Community 
would you approve or dis- 
approve? 
a) Quality of everyday 
language usage 2 13 0 13 87 
b) Type of occupations 4 30 2 9 70 
с) Ауегаре family income 4 36 4 1 64 
d) Educational level 4 27 0 11 73 
e) Interest in the arts 2 22 6 7 78 
1) Behavior characteristics 3 43 8 4 57 
g) Hospitality 8 57 1 6 43 
h) Cooperation with school 7 58 3 5 42 
Total 34 286 24 62 514 
Mean 35 65 
Ш. School Plant 
— Напі 
With what aspects of the 
School Plant would you 
approve or disapprove? 
a) Convenience of location 12 86 1 2 id 
b) Freedom from hazards 8 65 2 5 15 
c) Adequacy of heating 13 87 0 2 13 
d) Adequacy of lighting 12 80 0 3 20 
е) Adequacy of rooms 9 60 0 6 40 
f) Adequacy of furniture 5 33 0 10 67 
g) Provision for faculty 
privacy 4 21 0 11 13 
h) Adequacy of custodial 
service 8 53 0 7 47 
Total 71 491 3 46 289 
Mean 61 39 
P'=/Approvai O = Neutral N = Disapproval 
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TABLE XVI (Continued) 


Situations P % о N % 
IV. Тһе Administration 
With what aspects of the 
Administration would you 
Approve or disapprove? 
а) Education of the Board 9 15 3 3 25 
b) Philosophy of the Board 10 83 3 2 17 
с) Rules and regulations of 
к the Board 13 87 0 2 13 
Superintendent training 
and degrees 9 15 3 3 25 
e) Superintendent hired and 15 
amount of experience 1 85 2 2 
f)  Superintendent.educational 1 1 
philosophy 13 93 d 
8) Administrative policy in 
regard to: 
1. Student promotion 5 2а 9 m id 
2. Teacher experi- 58 3 5 42 
mentation 7 
3. Use of democratic 67 0 5 33 
procedures 10 
Total 87 656 15 33 244 
27 
Mean (Б 
а What aspects of the 
Бс Organization would 
approve or disapprove? 
a) Type of grading system n 13 0 4 21 
used 8 53 
b) Rigidity of use of grad- к 47 0 
ing system 
с) азса свв of curricular 5 33 0 10 or 
offerings 5 33 
d) School grouping of stu- 5 50 P 
dents' purpose 9 60 
e) Туре of student control 6 40 0 
used 0 9 60 
Г) School assemblies, fre- 6 40 
quency and purpose | 0 11 73 
g) Type and amount of guid- 4 27 
ance provided 0 13 87 
h) Guidance aids available 2 13 0 8 53 
: to teachers 1 41 
i) Health examinations 0 10 67 
j) Frequency and purpose of 5 33 
teachers' meetings 0 1 73 
К) Value of meetings to 4 27 
teachers 0 5 98 653 
62 43 
Total ga 61 
Меап 
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TABLE XVI (Continued) 
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Situations P % о М % 
VI. Instructional Materials 
With what aspects of the 
Instructional Materials 
would you approve or 
disapprove? 
a) Library's size and num- 
ber of references 8 20 0 12 80 
b) Library's adequacy in 
all areas 2 13 0 13 87 
с) Visual aids available 9 60 0 6 40 
d) Quantity of textbooks 11 73 0 4 21 
е) Adequacy of laboratory 
material 5 33 0 10 67 
1) Extent of Ше use of stand- 
ard test materials 4 27 0 11 73 
g) Provision for field trips 7 47 0 8 53 
h) Provision for outside 
talent 3 20 0 12 80 
Total 49 293 0 76 507 
Меап 87 63 
VII. The Faculty 
With what aspects of the 
Faculty would you approve 
or disapprove? 
a) Age range 9 60 3 3 20 
b) Training in years 10 67 0 5 33 
с) Faculty experience in 
years 9 60 1 5 33 
d) Percent of faculty living 
out of town 8 53 0 1 47 
e) Amount of help for 
faculty use 3 20 0 12 80 
f) Sick leave provisions 11 73 0 4 27 
g) Adequacy of professional 
library 2 13 2 11 73 
h) Method of choosing faculty 9 60 0 6 40 
1) Method of evaluating fac- 
ulty 5 33 5 5 33 
j) Base used in evaluation 4 21 6 5 33 
k) | Purpose for evaluation 4 27 5 6 40 
1) Friendliness of faculty 12 80 0 3 20 
Total 86 573 22 72 479 
Меап 54 46 
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TABLE XVI (Continued) 
Situations P % о N % 
ҮШ. The Students 
With what aspects of the 
es Student Body would you 
approve or disapprove? 
a) Pupil teacher ratio 6 40 0 11 73 
b) Distance of students 
from school 5 33 0 10 67 
c) Student performance 
as to: 
о 1. Attendance 2 13 0 13 87 
| 2. Level of scholar- 
ship 3 20 0 12 80 
3. Behavior 3 20 0 12 80 
4. Cooperation 6 40 0 9 60 
5. Appearance 5 33 0 10 67 
6. Friendliness 11 13 0 4 27 
d) Student attitudes in re- 
gard to: 
1. Toward fellow stu- 7 47 0 8 T 
дете 13 0 13 
2. Toward learning 2 53 4 10 87 
3. Toward faculty 5 67 
4. Towards rival 
Schools 8 50 9 T 47 
Total 63 425 0 119 195 
IX. The particular Position 
рк what features of Ше 
articular Position would 
You approve or disapprove? 
53 0 т 
a) Number of classes 8 41 
b) Appropriateness of your 12 80 0 3 20 
training 33 0 10 
9 Size of classes | 5 67 
Time spent on extra- 20 2 10 
curricular activities | 1 21 7 4 5 
е) Home room responsibility 
f) Requirement of lesson 8 53 3 4 97 
plans 
є) Time consumed by com- 8 53 0 1 47 
munity duties : 
h) Bases for determining 5 33 6 4 27 
p. | salary А 
i) Nature of contract provi- 10 61 3 2 13 
| sions 
j) Bases for granting рго- 6 40 4 5 33 
motion В 8 53 5 2 13 
к) Teaching method desired 12 80 2 1 ч 
1) Student relations desired 1 47 0 8 са 
m) Type of discipline wanted 8 53 2 5 33 
n) Committee work required 
692 34 72 
Total 104 481 
59 41 
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TABLE XVII 


RANK ORDER OF THE RESPONSES OF THE FIFTEEN SAMPLE AND ORIGINAL 
FORTY-FIVE SUBJECTS TO SELECTED AND ALL THE CATEGORIES OF 
THE INVENTORY RESPECTIVELY 


Rank Order of Rank Order of 
Interviewed Sample Original Sample 
Category of 15 of 45 
Administration 1 1 
School Plant 2 " 
Particular Situation 3 3 
Faculty 4 2 
Community 5 5 
School Organization 6 4 
Instructional Materials 1 6 
People of the Community 8.5 8 
The Students 8.5 9 
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SUBJECT NUMBER 32 


The analysis of the subject's responses to Ше 
various items of the Inventory (Table X) shows 
that satisfaction was expressed with sufficient 
frequency and with such degrees of intensity as 
to indicate a generally positive response. The 
mean total percent of satisfaction is 72.0. The 
five categories in rank order to which the sub- 
ject responded with the most satisfaction were 
instructional materials, 91.5 percent; school 
plant, 89.0 percent; students, 88. 0 percent; 
School organization, 86.0 percent; and adminis- 
tration, 78.0 percent. The items in regard to 
the instructional materials (Appendix B -1) to 
Which the subject responded ina highly favorable 
degree were all items in regard to the school li- 
brary, audio-visual material, text material, 
Standardized test material and supplementary 
material. In addition, in regard to the instruc- 
tional materials, degrees of satisfaction were 
registered for equipment furnished, condition 
and appropriateness of aids to classrooms and 
laboratories. The subject responded with dissat- 
tsfaction to only one item in reference to instruc- 
tional materials which was, the amount, number 
and size of aids for classroom and laborator 1 € S- 
The items in regard to the school plant (A pp en- 
Це B-1) to which the subject responded in à high- 
Y favorable degree were all items in regard to 
the site of school plant, the school building and 
floors, heating, lighting, rooms in the building, 
toilet facilities, furniture, faculty rooms and 
Custodial service. There were no items of the 
Эспоо! plant to which the subject responded in 

gree of dissatisfaction. 


The subject received a composite efficiency 


"ul (Xo) of 3.00, which places him 32. 5in the 
Ole group of forty-five. 
SUBJECT NUMBER 4 
ses to the 


The analysis of the subject’s гезроп 
thous items of the dos (Table X) s hows 
iat satisfaction was expressed with 5 ufficien 
Tequency and with such degrees of intensity Pr 
қа еше a generally positive response: і E" 
five рап percent of satisfaction уе ЖАЛ То 
епс highest satisfaction scores were w! faros 
subs to students which were 100 perc en А E 
m 001 plant which was 83.0 percent, the jd 
unity which was 78.0 percent, the people o m 
пр unity which was 76.0 percent, and the 2! 
nistration which was 75.0 percent. я 
еге were no items with regard to the TA 
to which this teacher responded with 41 
action. | 
Onl his subject responded with dissatisfaction 0 
Dp Опе item with reference to Ше schoo Le | 
the l'endix B-1), namely, the cooperativeno пе 
“Stodial service. АП other items 


dents 
Satisr 
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scored in such a manner as to indicate a high 
degree of satisfaction. 

This subject received a composite (Xo) teach- 
er efficiency rating of 2.25 which places him 18th 
in the whole group of forty-five. 


SUBJECT NUMBER 14 


The analysis of the subject's responses to the 
various items of the Inventory (Table X) shows 
that satisfaction was expressed with such fre- 
quency and with such degrees of intensity as to in- 
dicate a generally positive response. The total 
mean percent of satisfaction was 64.0. The five 
highest scores of satisfaction in rank order are: 
the administration, 100 percent; school organiza- 
tion, 78.5 percent; faculty, 75.5 percent; in- 
structional materials, 74.0 percent, and the stu- 
dents, 71.5 percent. 

The subject responded to ail the items of the 
administration (Appendix B-1) with a 100 percent 
of satisfaction. 

The items to which the subject responded with 
satisfaction in regard to the School organization 
were: the school year, daily sessions, grading 
system used, school curriculum, the school 
extra-curricular, methods of student соп trol, 
and school assemblies. In addition, satisfaction 
was expressed with the aids available to teachers 
for school guidance of students, pupil services 
in relation to health, nutrition and employment 
aids, also teacher meetings as to frequency, pur- 
pose, procedure and time of meeting, along with 
public programs given by the school. 

The items to which the subject reponded to as 
being dissatisfactory were: the type and amount 
of guidance provided, and the person or persons 
responsible for the guidance of students. In ad- 
dition dissatisfaction was expressed as tothe val- 
ue to the participant of teachers' meetings. 

This subject received a composite (Xo) teach- 
er efficiency rating of 3.00, which places him 
32.5 in the whole group of forty-five. 


SUBJECT NUMBER 15 


The analysis of the subject's responses to the 
various items of the Inventory (Table X) shows 
that dissatisfaction Was expressed with such fre- 
quency and with such degrees of intensity as to 
indicate а generally negative response. The mean 
total percent of dissatisfaction was «91,0, The 
five categories to which the subject re Бр onded 
with the most dissatisfaction were: the instruc- 
tional materials, -66.0 percent; the students, 
-54.0 percent; school plant, -45.0 percent; ad- 
ministration, -44.5 percent; and the school or- 
ganization, -21.0 percent. | | 

The items in regard to the instructional ma- 
terials (Appendix B-1) to which the subject re- 
sponded in a dissatisfactory manner were all 
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items in regard to the following: school epu d 
audio-visual materials, text materials, and E Y 
oratory classroom aids. The vA өресі Шаа 
with satisfaction to only опе item in regard to 
the instructional materials and it was the provi- 
sion for transportation for field trips. 

The items to which the subject responded to : 
as dissatisfactory in regard to the students were: 
the student's performance as to attendance, le у- 
el of scholarship, extra-curricular part icipa- 
tion, students' behavior, School pride, their co- 
operation, appearance and friendliness, attitude 
of students toward fellow students, learning, the 
faculty, and rival schools. Further dissatisfac- 
tion was expressed with the percent going to col- 
lege, in National Student Associationand the num- 
ber of inter-scholastic championships. There 

were no items of the students to which the sub- 
ject responded to in any degree of satisfaction. 

The subject received a composite efficiency 
rating (Хо) of 3.00, which places him 32.5 in the 
whole group of forty-five. 


SUBJECT NUMBER 7 


The analysis of the Subject's responses to the 
various items of the Inventory (Table X) shows 
that dissatisfaction was expressed with suffi- 
cient frequency and with Such degrees of inten- 
Sity as to indicate а generally negative response. 
The mean total percent of dissatisfaction was 
-13.5 percent. The five categories in which 
the subject indicated the most dissatisfaction 
were: the school plant, -26.5 percent; the stu- 


dents, -19.0 percent; administration, -16. 5per- 
cent; Ше particular position, 


were: degree of moderness of the school build- 
ing, provisions for ventilation, inadequate heat- 
ing, size of the rooms and their decoration, ar- 
rangement of the room and freedom from disturb- 
ances, usefulness of the furniture, number of 
faculty rooms with provisions of privacy, and 
the cooperativeness and competency of the cus- 
todial service. There were no items of the 
school plant to which the subject responded with 
a degree of satisfaction. 

The individual items, in regardto the Students, 
to which the subject responded with a degree of 
dissatisfaction were: the performance of the stu- 
dents in regard to attendance and levelof Scholar- 
ship, extent of social activities, behavior of stu- 
dents, students' cooperation and appearance, 
and attitude of students toward learning and fac- 
ulty. There were no items of the s tudents to 
which the subject responded in any degree of sat- 
isfaction. 

The subject received a composite effic iency 
rating (Xo) of 3.50, which places him 39th in the 


whole group of forty-five. 
SUBJECT NUMBER 26 


The analysis of the Subject's responses to the 
various items of the Inventory (Table X) shows 
that dissatisfaction was expressed with sufficient 
frequency and with such degrees of intensity as 
to indicate a generally negative response. The 
total mean percent of dissatisfaction was -9.0. 
Five scores of dissatisfaction in rank order were: 
the community, -25.5 percent; School plant, 
-20.5 percent; people of the community, -14.5 
percent; school organization, -14.0 percent; and 
the students, -6.5 percent. 

The items with reference to the community 
with which the Subject responded to a degree of 
dissatisfaction were the section of the state in 
which the community was located, the size of 
the population of the community along with the 
community area and Spread. issatisfaction 
was also registered with the community accessi- 
bility, the Surrounding area of the community and 
the type of industries found. This Subject was al- 
50 dissatisfied with the activities of the churches, 
Schools other than Public, along with the avail- 
ability of good dentists and doctors, and the con- 


venience of a hospital. Still this subject was dis- 


satisfied with the public libraryas to convenience 
of opening hours, adequacy of materials and the 
гесепсу of the books, and other materials. Fur- 
thermore, dissatisfaction was registered for so- 
cial groups as to their diversity, purpose and 
contribution to the community. Thelackof pri- 
уасу in living quarters, the meal acc o mmoda- 
tions as to type found available, and the quality 
of food was indicated as dissatisfactory by this 
Subject. As to rentals, prices paid for meals 
and £roceries, and the cost of sundries this sub- 
ject registered dissatisfaction. Finally, the sub- 
ject registereq dissatisfaction with the cultural 
Opportunities in the community, the distinctions 
of the community, leisure time Opportunities in 
regard to amusements and recreation available, 
along with extra job Opportunities. 

Тһе items with reference to the community 


was located; the type, location, modernness, re- 
Strictions, and the degree of privacy providedas 
to living Quarters. As to location of mealaccom- 
Modations it was found to be Satisfactory along 


The items with reference to th 4 
і ant 
(Appendix B-1) with which е school p 
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dissatisfaction with the toilet facilities available, 
furniture in the building, and the faculty room 
With reference to the number, degree of pri- 
уасу afforded and regulations for its use. Тһе 
Subject responded to only three items with a de- 
Егее of satisfaction in regard to the school plant 
and they were the adequacy, competency, and 
Cooperativeness of the custodial service. 

This subject received a composite (Xo) teach- 
ег efficiency rating of 2.00, which places him 
12th in the whole group of forty-five. 


SUBJECT NUMBER 17 


The analysis of the subject's responses to the 
various items of the Inventory (Table X) shows 
that dissatisfaction was expressed with sufficient 
frequency and with such degrees of intensity as 
to indicate a generally negative response. The 
mean total percent of dissatisfaction was -3. 0. 
This teacher was more dissatisfied than satis- 
fied with the following five categories in rank 
Order: the school plant, -47.0 percent; adminis- 
tration, -28.0 percent; instructional materials, 
-27.0 percent; students, -6.5 percent; andthe 
people of the community, -5.0 percent. 

+ Тһе items in regard to the school plant (Ap- 
pendix B-1) to which the subject responded with 
à degree of dissatisfaction were: the freedom 
from hazards and the appearance of the school 
Етошпав, the school building in regard to type of 
Construction, degree of modernness, adequacy 
ОЇ exits, and provision for ventilation. Further, 
dissatisfaction was expressed with rooms, toi- 
let facilities, floors, and furniture of the build- 
Ing. In addition, dissatisfaction was expressed 
in the lack of provision for a faculty room, and 
б е adequacy, competency and соор 

the custodial service. 

Degrees of satisfaction in regard to Ше school 
Plant Were expressed for the location of the 
School plant, adequacy of heating and lighting. 

е items in regard to the administration (Ap- 
шй B-1) to which the subject меен +. 
ер ee degree were Ше general 5 паці 
of th level of the School Board, the prac : аа 
Боо; Superintendent, and the administra tt А 
а + of the Superintendent іп regard to sian м 

ilit, 27 Promotion, standards for student elig 
Y, teacher research and experimentation 1n 


erativene S S 


th 
in ee of democratic procedures. The Hem» 
lect IM to the administration to which the px 
educ, Ропдед in a satisfactory degree меге © 
ang ір 10141 philosophy of the Board of Education, 
them, © “Ules and regulations promulgated by 
iciency 
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SUBJECT NUMBER 22 


The analysis of the subject's responses to the 
categories of the Inventory (Table X) shows that 
dissatisfaction was expressed with a sufficient 
number of items and with such degrees of inten- 
sity and frequency that the response would ap- 
pear to indicate an overall negative response. 
The balance of responses to all the categories 
was such that this subject received a mean total 
percent of satisfaction which was 0.5. The high- 
est dissatisfaction of this teacher was shown in 
the items of the school plant, -12.5percent. The 
instructional materials and the school organiza- 
tion received the same degree of dissatisfaction 
respectively, -11.5 percent. The next two low- 
est categories were the particular position, and 
the faculty receiving scores of -4. 0 and 0. 0 per- 
cent respectively. 

The items in regard to the school plant (Ap- 
pendix B-1) to which the subject responded with 
a degree of dissatisfaction were the degree of 
modernness of the building, its provisions for 
ventilation, and adequacy of performance of heat- 
ing and lighting. In addition, negative responses 
were given to adequacy of size, appropriateness 
of decoration, convenience and arrangement, 
and the freedom from disturbances of rooms in 
the building. The subject also responded with 
dissatisfaction with the condition of the floors, 
and the lack of a faculty room for privacy. This 
subject responded to a satisfactory de- 
gree to only one item in regard to the school 
plant which was cooperativeness of the custodial 
service. 

The items to which the subject responded to 
as being dissatisfactory with reference to the in- 
structional materials (Appendix B-1) in regard 
to the library were: its size, number of refer- 
ences, its adequacy for all areas, recency of 
books and materials and their variety and range 
of difficulty, and the suitability of periodicals. 
In addition, a negative response was registered 
for the poor and worn condition of textbooks. 
There were only two items, in reference to the 
instructional materials, for which this teacher 
indicated a degree of satisfaction and they were 
the up-to-dateness of text materials and the pro- 
vision for class transportation for field trips. 

The items with which this teacher was dissat- 
isfied in reference to the School organization (Ap- 
pendix B-1) were the vacation allowed, length of 
the class periods, the rigid use of the School 

rading system, and with the importance it holds 
a the pupils. In addition, this teacher regis- 
tered dissatisfaction with the diversity cw var- 

iety of extra curricular offerings, type of m 
control used in the whole school along will the 
frequency, purpose, responsibility for organiz- 
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i e value of school assemblies to the 
oo на dissatisfaction was indicat e d 
with reference to the type and amount of gui d- 
ance available to students. Furthermore, this 
teacher was dissatisfied with the aids available 
to teachers for the guidance of students. The 
items to which this subject responded to a satis- 
factory degree in regard to the school organiza- 
tion were the time of the beginning and closing of 
the school year and the hour of opening of the daily 
Sessions. Finally, this teacher expressed satis- 
faction with the provisions made for nutritional 
needs of the students in school. 
This teacher received a composite teacher 
efficiency rating (Xo) of 3.25, which places him 
36th in the whole group of forty-five. 


In looking back over the ten case studies, it 
appears that.two of the highly dissatisfied teach- 
ers also received high efficiency ratings. These 
two cases will be examined in Somewhat greater 
detail. Looking at the particular items with 
which they expressed dissatisfaction, Teacher 26 
gave the larger overall negative response of 
these two teachers, namely, -9.0. While teach- 
er 17 had a negative score of only -3.0, she was 
highly dissatisfied with the school plant, admin- 
istration, and instructional materials. Inspite 
of his dissatisfaction with the administration, he 
Secured the highest efficiency rating of alltheten 
teachers studied. Teacher 26 did not like the 
community, the school plant, the people in the 
community, nor the school organization. 

If we examine the responses of the two teach- 
ers with the highest Satisfaction scores and the 
highest efficiency Scores, we find that Teacher 
4 was dissatisfied with only one item, name ly, 
the custodial service. Teacher 13 responded 
with dissatisfaction to no items. In general it 
would appear from these case Studies and other 
data supplied in this investigation, that teachers 
are more satisfied than dissatisfied with the 
learning-teaching situation in which they find 
themselves, and generally they possess more of 
this quality than poor teachers. Teachers 17 and 
26 as already indicated are exceptions to this 
statement. 

Ordinarily it would be presumed, too, that 
good teachers would have some definite dissatis- 
factions. That is, one would expect good teach- 
ers to be definitely dissatisfied with what they 
consider important aspects of the Situation, par- 
ticularly those closely related to the learning- 
teaching situation. Not to be dissatisfied with 
Such items would indicate, in many instances, 
incompetency. 

A further study of the ten individuals reveals 
that the five most dissatisfied teachers taught in 
communities with populations of 200, 519, 956, 
1190, and 2050, respectively, while the five most 
satisfied taught in communities with populations 
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of 1444, 6849, 11088, 11867, and 42365. Four 
of the five most satisfied teachers worked in 
larger communities, and the five most dissatis- 
fied teachers worked in smaller com munities. 
This is what one would expect considering the 
lack of facilities in smaller communities. Two 
of the five small community teachers weregiven 
high efficiency ratings. They probably did find 
much with which to be dissatisfied. 

The analysis of the five most satisfied and 
dissatisfied teachers would Seem to indicate that 
the size of community may be related to satis- 
faction-dissatisfaction but not efficiency ratings. 

In analyzing the pattern of responses of the 
four case Study teachers who received superior 
efficiency ratings, it appears that the y were 
more satisfied than the other case study teach- 
ers with other items of the Inventory. 


SECTION IV 
SUMMARY AND CONC LUSIONS 


THE PURPOSE of this investigation was toas- 
certain the relationships of certain environment- 
al factors to teaching success. 

The subjects of the Study were Sixty seniors 
who had graduated in 1950 from a four 


Г ief data Eathering device employed in 
the Investigation was a Teacher Situation Inven- 


tory consisting of two pages of directions and 


nine Sections of items relative to the si tuation 
listed under the following 


4 - The Inventory was mailed to sixty- 
іуе 1950 gr -nine filled out and re- 


ceptability rating, the w 
the M-Blank rati 


mined for all Categories of t 
each respondee. These da — а 
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lati 8 
NC the various criteria of teacher effi- 
X дк с rah of selected items was also made in 
disliking у е reasons for the subjects’ liking or 
which the yera aspects of the environment in 
the fifteen ound themselves. The responses of 
аниад satisfied and the fifteen most 
tail in 1... were examined in some де- 
Sis of the r ion to efficiency ratings. Ап analy- 
ventory an, срам to selected items of the In- 
ple who did ined from interviewing fifteen p е0- 
This was deer respond to the form was made. 
ing the Төлен | to determine how those not return- 
environment Ory responded to aspects of their 
Most satisfie Finally, case studies of the five 
teachers sated and the five most dissatisfied 
relatio ere made to explore in more detail 
teachers pnp AH between the reactions of the 
and their к School-community environoment 
A numb сарвар. 
found to be r. of environmental factors Were 
findings ча related to teacher efficiency. The 
Question re summarized relative to the four 
5 asked earlier: 


l. Wi 
` With Е 
реаг ens Situational factors do teachers ap- 
e more satisfied or dissatisfied? 


Tea 
ministres appear to be satisfied with: the ad- 
Organization faculty, particular position, school 
terials пет the community, instructional m à- 
and stude chool plant, people of ће сот m unity, 
ers Were nts, in the order given. Sixteen teach- 
teachers satisfied with all nine factors. Five 
tors. Were dissatisfied with six or more fac- 
Showeg dis remaining twenty-four generally 
г №0 sity atisfaction with one or two factors. 
actio wa uational factors with which dissatis- 
r dents к eR most frequently меге the 
or pect to the people of the community: Wi 
all hae nine factors, the mean responses 
ers showed a degree of satisfaction. 


` What si 
за With чайопаї factors seem to be associat- 
teaching Success? 


Low ам 
и м. correlations were obtained be- 
s Ponses 9f the efficiency ratings andthe mean 
Or hi vironm all teachers to various aspects of 
ing d er ненні Positive correlations O^" , 
ànd f the ere found between an efficiency rat- 
the (ог ei Зи responses to Ше Inventory 
san Vento t of the nine categories included in 

'Stied ang “the analysis of the fifteen mos 
Ëroup ES e fifteen most dissatis 4 
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The than зы. lower satisfactory efficiency ж 
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the students, the faculty, and the school organi- 
zation. The data with reference to the other two 
criteria were inconsistent. 


3. To what degree can teacher success be pre- 
dicted on the basis of situational factors? 


While there is a positive relationship between 
efficiency and teacher satisfaction, Ше согге1- 
ations are uniformly low, and taken as a group 
are not likely to prove of substantial predictive 
value. In combination with other factors in teach- 
er efficiency one would expect to reduce the error 
of estimate by adding to the regression equation 
a situational factor. 


4, What situational factors do teachers think 
should be changed? 


teachers were satisfied with nearly all 
aspects of their situations; others were dissatis- 
fied with nearly all aspects of their situation. 
The following observations seem warranted: 

a. The total group of respondees were least 
satisfied with their students and would like 
a better attitude from students toward learn- 
ing, improved scholarship, consistent at- 
tendance, better attitudes toward the facul- 
ty, and greater desire to go to college. 

p. Almost as many respondees were dissatis- 
fied with the people of the community as 
those satisfied. They preferred a higher 
general educational level for the people, 
better everyday language usage, and great- 
er interest in the arts. 

c. Many respondees desired а better school 

lant. Those aspects of the sc hool plant 
which they would like improved included a 
room for faculty members, more privacy, 
and improved personnel апа services. 
ipal improvements suggested in 
the category related to instructional mater- 
jals were а larger library and more ade- 
quate jibrary facilities for all areas of in- 
struction, more up-to-date materials and 
a greater variety of classroom aids, better 
ns for conducting field tr ips and 
mmunity re- 


Some 


more ех 
urces. + š 
50 Jor improvements desired with ref- 


ajo 
memi ity included better cul- 
nd leisure time opportunities, pro- 


]t education, opportunity for 
ore adequate bus and 


edules. | | 
cts of school organizations 


ived the greatest attention with 
r improvement were more 
hool assemblies, 
guidance Serv ices 
ul 4 
bier d to be employe d in 


with а skilled person 


150 


more schools and more guidance materi- 
als made available to teachers, tea cher 
meetings in which the problems of instruc- 
tors are given adequate attention, and 
clearly defined operating procedures for 
the student council. | | 

с. Some suggestions were made in relation to 
the particular position for increasing sal- 
aries, improving the system of promotion, 
decreasing the number and size of classes, 


and decreasing the number of extra-curric- 


ular activities assigned to a given teacher. 

h. The number, type and competence of as- 
sistants to the faculty, the adequacy of the 
professional library, and the method, pur- 
pose, and basis of evaluation of the facul- 
ty received many Suggestions for improve- 
ment. 


m 


ards of promotion, for Clarifying and im- 


field that might limit or enhance their effective- 


ness. Such information should also enable teach- 


er education institutions to help teachers build 
understandings, Skills, and attitudes necessary 


to meet various environmental conditions. Teach. 
er education institutions might also utilize find- 


ings from this study at the graduate level in 
courses for supervisors and administrators, 
Finally, the information should be of value to 
placement officials in that the abilities of teach- 
ing candidates and demands of situations might 
be considered more intelligently. 
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ANALYSIS OF CERTAIN ASPECTS OF 
TEACHING ABILITY 


MARGARET LOIS JONES 
Illinois State Normal University 
Normal, Illinois 


SECTION I 
THE PROBLEM 


MANY STUDIES have been made of gradu- 
ates of teacher training curricula to determine 
their success as teachers. These studies have 
been concerned in one way or another with the 
measurement and evaluation of teaching success. 
Such evaluation is of considerable interest be- 
cause of the importance of the teacher in the en- 
vironment of the child. Baxter (6) points out: 

‘It is no longer enough that the teacher be the 
possesser of knowledge. Today's teacher must 
be а “social engineer', capable of setting пра 
provocative environment for children's learning, 
charting the course of each individual child 
through the ever-changing social relationships 
in which he is involved and assisting each pupil 
to grow in his understanding of himself and 
others. " Considering this role of the teac her, 
it can be readily realized that it is of greatest 
importance to secure the best possible teachers 


Гог our schools. 
Teacher training institutions are confronted 


not only with the problem of selecting those can- 
didates who show the most promise of becoming 
Successful teachers, but also the problem of 
Providing those curricular and extra-curricular 
activities which will aid those candidates when 
they have entered the training program. Evalu- 
ation of teaching efficiency and identification of 
the factors which contribute to teaching success 
аге important in both the selection and training 
of candidates. 

Evaluation of teaching success 
Proached in many different ways- 
has been to ask students to list traits or charac- 
teristics of the teacher “Ікей most" and the 
teacher ‘liked least". Another approach has 

€en to measure certain characteristics of pro- 
SPective teachers in training and to correlate 

в measures with various estimates of 5 ue 
SS obtained after they had been taught.. A thir 


has been ap- 
One approach 


“The author wishes to express 5 


this 


Бе 
Tved аз subjects and contribu 


е of this investigations 


the cours® ond for his critical ге 


Suggestions in the initial stages of end 
t d W. Harris who helped in plann dissertation; 
ganization of the pom i illingly to this 


approach has been to study good and poor teach- 
ers at the time they are teaching for thepurpose 
of noting qualities or procedures associated with 
success. 


Statement of the Problem 


This dissertation is concerned with measures 
of certain characteristics of good and average 
teachers obtained at the time they are already 
teaching. Some preservice achievement meas- 
ures will be used, but the study is primarily con- 
cerned with temperament as measured by objec- 
tive tests and other measures. 

A group of good teachers and a group of av- 
erage teachers will be defined in terms ofthree 
criterion estimates of teaching success: Prac- 
tice teaching grade, Placement Bureau Rating, 
and Principal's M-Blank Rating. 

The primary purpose of this study is to deter- 
mine whether a group of good teachers can be 
differentiated from a group of average teach ers 
in terms of certain measures of preservice a- 
chievement, temperament and personality. In 
order to determine whether a pattern of these 
characteristics may differentiate the two groups, 
a multivariate analysis of variance technique 
will be employed. 

Depending on the results of the analysis of var- 
iance, a further investigation will be made to de- 
termine the relationship between certain of the 
measured characteristics of teachers and acom- 
posite of the criterion estimates. The canonical 
correlation method proposed by Hotelling (33) 
will be employed to determine the weights to ap- 
ply to each of the criterion estimates to form the 
composite. 

The study attempts to answer the following 
specific questions: 


1. Is there a significant difference between the 
group of good teachers and the group of aver- 
age teachers in terms of the profile of group 
means for all the variables? 

2. Is therea significant difference between the 


group of good teachers and the group of av- 
who helped in the completion of 


d for the constant encourage- 
to Dr. Burton М. Kreitlow for 


and who made valuable suggestions on the 


i desi ese 
же , to the teachers and principals who 


and Ї 


researche 
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erage teachers in terms of classes of vari- 

ables (preservice achievement vari ab les А 

temperament variables and personality vari- 
? 

3. E the canonical correlation between a 
weighted composite of the c ri terion esti- 
mates and a linear combination of certain of 
the preservice achievement, temperament 
and personality measures? 


It appeared from the results of many of the 
researches in the area that measures of pre- 
service achievement, temperament and person- 
ality of teachers might be promising in a study 
of the evaluation of teaching success. 

In this investigation, the preservice achieve- 
ment measures are those measures obtained for 
each teacher some time prior to her receiving 
the Teacher's Certificate and accepting a teach- 

ing position. Two preservice achievement 
measures were obtained from the American 
Council on Education Psychological Examina- 
tion administered to each teacher at the time 
She entered the University of Wisconsin. T wo 
other preservice achievement measures were 
based on (1) grades earned in professional 

courses in Education taken during the Junior and 

Senior years, and (2) grades earned in courses 
taken in the teaching major. 

Temperament is investigated in this disser- 
tation by means of two kinds of measures: (1)al- 
ternation tests of flexibility, and (2) creative ef- 
fort tests of disposition rigidity. Both these 
kinds of tests are what have been called by Cat- 
tell (10а) and others “objective tests of temper- 
ament." These objective tests demand no at- 
tempt at self-evaluation by the Subject, but are 
Speed tests designed to measure ability of the 
subject to perform some task in a given situa- 
tion. 

Flexibility and disposition rigidity are two 
components of an aspect of temperament which 
has been termed perseveration by many writers. 
Perseveration has many theoretical connota- 
tions, such as Spearman’s “шепа! inertia" con- 
cept (57) and the ‘‘memory phenomenon" inter- 
pretation by other writers (25). The present 
study avoids these connotations by accepting Cat- 
tell's (17) definition of disposition rigidity and 
Kleemeier and Dudek's (38) definition of flexibil- 
ity. 

Y саней defines disposition rigidity as a ‘‘dif- 
ficulty (slowness) in turning from old to new re- 
sponses to a situation when the individual wills 
to make them."' This temperament factor is 
best measured by creative effort tests in which 
the individual tries to perform an old task in a 
new way. For example, it could be measured 
by the number of times the subject could write 

the numbers “287” in the usual way divided by 
f times he could write the same 
the number 0 


(Vol. 25 


numbers using reverse strokes. 

Flexibility is defined by Kleemeier and Dudek 
as the ability to shift from one task to another. 
They say this is best measured by alternation 
tests in which the subject is required to do first 
one simple task, then another, and finally is re- 
quired to do both tasks in the same test. The 
third test is considered the measure of flexibil- 
ity because the subject is required to shift from 
one task to another in the same test. For ex- 
ample, the subject might be required in Test 1 
to answer as many two-digit addition problems 
as he could in two minutes, then in Test 2 to an- 
Swer as many two-digit subtraction problems as 
he could in two minutes, and finally in Test 3 to 
answer as many mixed addition and subtraction 
problems as he could in two minutes. A high 
score on Test 3 indicates a higher degree of flex- 
ibility in shifting from one task to another. 

Personality is investigated in this disser ta- 
tion by a self-evaluation made of five “traits” 
chosen from a personality inventory. я 

Certain considerations regarding the meaning 
of the terms personality and temperament аз 
used in this study are important. Allport (1) 
Speaks of temperament as a certain class of raw 
material from which personality is fashioned. 
“Strictly speaking there is no temperament a- 
part from personality, nor any personality de - 
void of temperament. ” 

The term temperament is usually employed 
in speaking of dispositions that are almost un- 
changed from infancy throughout life. 

Allport (1) gives this definition of tempera- 
ment: ‘‘Temperament refers to the characteris- 
tic phenomena of an individual's emotional na- 
ture, including his susceptibility to emotional 
Stimulation, his customary strength and speed 
of response, the quality of his prevailing mood, 
and all peculiarities of fluctuation and intensity 
in mood; these phenomena being regarded as de- 
pendent upon constitutional make-up, and there- 
fore largely hereditary in origin. '' 


Significance of the Study 


_ Teacher training institutions attempt in var- 
lous ways to evaluate candidates for the purpose 
of selecting those persons who are most likely 
to become £ood teachers. Knowledge of factors 
in teaching success is important in order to in- 
crease the effectiveness of these evaluations. 
AS a result of the present study, differences 
between good and average 
by three criterion r 


elationships between 
ures of certain teach- 
indicated or not indi- 


If differences are indic 


ated or if significant 
relationships are found, t 


his would contribute to 


x 
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Ше understanding of factors associated with 
teaching success. Results of the study should 
also provide a valuable source for pointing out 
teacher characteristics which should be investi- 
gated in further research. 

И differences аге not indicated, or signifi- 
cant relationships are not found, it must be con- 
Cluded that in subsequent research other defini- 
tions, measuring devices or general plan of in- 
vestigation should be employed. 


SECTION II 


DESIGN OF THE STUDY 


The Teacher Population Studied 


THE TEACHER population studied consisted 
of the 1951, 1952 and 1953 women graduates of 
the University of Wisconsin who had received 
the Teacher's Certificate from the School of Ed- 
ucation and who were still teaching in Wisconsin 
secondary schools. 

The population was further defined to include 
all those women who were teaching in secondary 
schools located within approximately one hun- 
dred miles of the City of Madison. One hundred 
and twelve persons were in this group. 

From this group of one hundred and twelve 
persons, the names of sixty persons were ran- 
domly drawn. The Fisher-Yates Table of Ran- 
dom Numbers (20) was used in this procedure. 

Although this randomly drawn sample consist- 
ed of sixty persons, the group finally studied in 


this investigation consisted of only forty-sixper- 


Sons for whom complete data were available. By 
ts used in this study 


the fall of 1954 when the tes 
Were given, seven members of the sample of 
Sixty had changed their residence from the State 
Of Wisconsin. An additional seven person? had 
to be eliminated from the sample because two 
Subscores (Quantitative Score and Linguistic 
Score on the American Council on Educatior 
Psychological Examination) 'used 25 part of the 
ata in this study, were not available for th em. 
на fourteen persons were eliminated from the 
andomly drawn sample of sixty. — . ЕА 
th Since fourteen persons were eliminated Bs 
ihe Sample of sixty, the group of forty-SiX 41 8. 
erc teachers finally studied cannot be conste 
ей precisely a randomly drawn sample. In 
Ж to estimate the amount of bias which m RT 
Bone resulted from this loss, certain gau 
Я S between the group of forty-six tea che : 
Studied and the group of fourteen teachers и 
аге m Would seem pertinent. If the two Є 
= нес milar іп terms of these comparisonS |, 
Thi tS of the bias may be judged а m inim 
Would s ay be јпав the use of 
за provide some evidence for ше ual 
"ple of forty-six persons in а statist 
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design requiring the assumption of random sam- 
pling. 

Comparisons between the group of forty-six 
апа. ће group of fourteen were made in terms of 
(A) the Mean Total Grade Point Average for each 
group and (B) the Median Percentile Rank (total 
score) for each group on the American Council 
on Education Psychological Examination. Table 
Ishows these comparisons. 

A test of significance of difference between 
means, given by McNemar (43), was usedto test 
the significance of difference between Mean 
Grade Point Averages. А sum oí ranks test (61), 
applicable to non-normal distributions, was ap- 
plied to test the hypothesis of no difference be- 
tween the two Median Percentile Ranks. 

Neither of these differences was statistically 
significant. Therefore, it would seem the group 
of forty-six and the group of fourteen were sim- 
ilar in terms of academic achievement as meas- 
ured by grade point average and intelligence as 
measured by the American Council on Education 
Psychological Examination. It is believed the 
sample of forty-six, while not precisely a ran- 
domly drawn sample, may be used in ananalysis 


of variance design. 
Description of the Subjects 


The forty-six subjects in this investigation 
were women teachers in secondary schools in 
Southern Wisconsin. They were all graduates of 
the University of Wisconsin and had receivedthe 
Teacher's Certificate from the School of Educa- 
tion. Six members of the group had graduatedin 
1951, seventeen in 1952 and twenty-three in 1953. 
The range in ages to nearest birthday was from 
22 to 26 years while the average age for the group 
was approximately 24 years. Nineteen of the 
group were married and twenty-seven were not. 
Thirty-four entered the University of Wisconsin 
as freshmen and completed the entire four year 
college course atthis University. Twelve en- 
tered the University 45 transfer students. 

Table II shows the variety of subjects taught 
by the forty-six teachers. | 

Certain comparisons between the forty - six 
n who are subjects in the present study 
and women graduates of the University of Wis- 
consin School of Education in previous years are 
shown in Table IH. RR 

The data in Table III would seem to indicate 
the group in the present study is not markedly 
different from women graduates of other years 
in terms of academic achievement. 

The Mean Total Score Percentile Rank on the 
American Council on Education Psycholog ical 
Examination for the group of forty-six teachers 
is 62.46. Lins (41a) obtained a mean of 61.42 
for the fifty-eight (1942) women graduates who 


were subjects in his study. 


wome 
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TABLE I 


COMPARISON BETWEEN THE GROUP STUDIED AND THE GROUP NOT STUD- 
IED IN TERMS OF TOTAL GRADE POINT AVERAGE AND TOTALSCORE 
MADE ON AMERICAN COUNCIL ON EDUCATION Psyc HOLOG- 
ICAL EXAMINATION 


Mean Total Med. %ile Rank 
G.P. Average (TotalScore) ACE 
Group of 46teachers 
studied 


1.92 67 


Group of 14 teachers 
not studied 1.89 


TABLE II 


SUBJECTS OR COMBINATIONS OF SUBJECTS TAUGHT BY THE 
FORTY-SIX TEACHERS 


ese, с, 


| | Teaching Each Subject 
Subject or Subjects Taught ог Combination 


English, English Literature, or English 
plus another subject 


15 
Math and Science Р 
Ноте Есопотісѕ ia 
Foreign Language (French, Latin, Spanish) 2 


History, Civics, Social Studies 
Art Education 
Business Education, Commerce 


Music 
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TABLE III 


COMPARISON BETWEEN SUBJECTS IN PRESENT STUDY AND 
GRADUATES OF PREVIOUS YEARS 


Subjects in 1942 Women Grad- 1950 Women* 
Present Study uates (Lins' Study) Graduates 
N= 46 N = 58 N = 136 
Total Grade Point Average 

Mean 

1.92 1.877 1.889 
S.D. 

0. 38 0. 382 0. 359 


*Data obtained from the Offi 
ice of Student Perso isti i i i i 
о пле! Statistics, University of Wisconsin, 


TABLE IV 


RELIABILITY ESTIMATES OF KLEEMEIER-DUDEK BAT- 


TEST-RETEST 
TERY OF FLEXIBILITY TESTS (N - 53) 


Test-Retest 


Name of Test Reliability Estimate 


Two-Digit Numbers 
Addition „78 
Subtraction .87 
Mixed .88 
Word Completion 
Add Final Letter „59 
Add Initial Letter . 71 
Mixed .53 
Perceptual Speed d 
Count N's E m 
Count W's | E 


Mixed 
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ied appear to be rea- 
The group presently studie 
асан representative of women graduates ої 
previous years who have received the Teacher 5 
Certificate from the University of Wisconsin 
School of Education. 


Data-Gathering Devices Employed 


Twenty-three variables were involved in the 
present study. Three of the variables were es- 
timates of teaching success and twenty were 
measures of certain teacher characteristic 5. 
Of these twenty measures of teacher character- 
istics, four were measures of preservice a- 
chievement, five were measures of personality 
and eleven were objective tests designed to 
measure certain aspects of temperament. 

The twenty-three variables are listed below. 
The number preceding each variable is used to 
identify that measure in reporting the analysis 


of the data. A code Symbol follows each meas- 
ure. 


Measures of Preservice Achievement 


( 1) Quantitative Score (9), American 
Council on Education Psychologi- 
cal Examination, 1948 edition Q 

( 2) Linguistic Score (9), American Coun- 
cil on Education Psychological Ex- 
amination L 

( 3) Professional Grade Point Average, 
based on grades earned in Educa- 
tion 73, 74, and 75 


PGPA 
( 4) Grade Point Average earned in 
courses taken in teaching major MGPA 
Objective Measures of Temperament 
Creative Effort Tests—Cattell 
( 5) Reverse Strokes Disposition 
Test Rigidity Sub 6 
( 6) The Alphabets Disposition 
Test Rigidity Sub 7 


Battery of Alternation Tests—Kleemeier-Dudek 


( 7) Two-Digit Numbers, Addition TDN Add 
( 8) Two-Digit Numbers, Subtraction TDN Sub 
( 9) Two-Digit Numbers, Mixed 
Flexibility TDN Mix 
d Completion, Add final 
nid Р і letter WC Final 
d Completion, Add initial 
ли и letter WC Initial 
d Completion, Mixed | 
адын Flexibility WC Mix 
(13) Perceptual Speed, Count N's PS N's 


11 references to Appendices may be found in original thesis, Library, 
А 
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(14) Perceptual Speed, Count W's PS W's 
(15) Perceptual Speed, Mixed | 
Flexibility PS Міх 


Guilford- Zimmerman Temperament Survey 


(16) General Activity vs., Slowness 


Inactivity G 
(17) Restraint vs., Impulsiveness R 
(18) Ascendance vs., Submission A 
(19) Sociability vs., Shyness, 

Seclusiveness S 
(20) Emotional Stability vs., Neurot- 

icism E 
Criterion Estimates of Teaching Success 
(21) Practice Teaching Grade, Edu- 

cation 75 PT 
(22) Placement Bureau Rating PB 
(23) Principal’s M-Blank Rating PM 


Sources of Data 
— — S: рата 


Тһе following data Were obtained from Uni- 
Versity records: 


1. Quantitative Score and Linguistic Score were 
obtained from records kept at the Student 
Counseling Center of the University. These 
Scores were derived from the American Coun- 
Cil on Education Psychological Examination 
Which is administered to all students entering 
the University. 

2. The Grade point averages earned in the three 
professional Education courses and in the 
Courses taken in the major teaching field were 
obtained from records in the Registrar's Of- 
fice of the University. 


Data for a. 
by admini 


University of Wisconsin, 


December, 1956) 


The practice teaching grade for each subject 
Was obtained from records on file in the Wis- 
Сопвіп High School Office of Student Teacher 
Records. 

The Placement Bureau rating was obtained 
from the Assistant Director of the University of 
Wisconsin Teacher Placement Bureau. 


Description of the Measures Employed 


(1) American Council on Education Psychologi- 
cal Examination for College Freshmen (Ap- 
pendix C) 


Percentile rank on each of two subscores 
Quantitative and Linguistic, yielded by this ex- 
amination were measures of intelligence em- 
ployed in this study. Fourteen of the subjects 
who entered the University in the Fall of 1948 
were administered the 1947 edition of the test; 
the remainder of the subjects (32) who entered 
in the Fall of 1949 or as transfers in1950, were 
administered the 1948 edition of the test. P er- 
centile ranks were determined on the basis of 
national norms. 

The examination consists of six tests grouped 
in two general classes as follows: 


Quantitative Tests (Q Linguistic Tests (L 
^ Score) Score): 
Arithmetical Rea- Same-Opposite 
soning Completion | 
Number Series Verbal Analogies 


Figure Analogies 


Subscores based on results of these two sets 
of tests were used in the present investigati o n. 
Factor analysis studies have indicated that two 
distinct kinds of mental abilities appear to be in- 
Volved in performance on these six tests (19). 
High Q and 1, scores indicate high levels of per- 


formance in each of the abilities assessed. 


(2) Professional grade point average 


ted on the ba sis of 
3, 74and75. These 
ion offered 
niversity of 
ge indicat- 
mntinpro- 


Ta average was compu 

are багпед in Education 

by th rofessional courses in educat 

| ‘пе School of Education at the U 

Consin. А high grade point avera 

ера вне level of academic achieve 
tonal education courses. 


(3) с | 
Trade poi i major teaching 
field point average in the maj 


tificate 


aj" Candidates for the Teacher's Cer 
f cred- 


its in Quired to take a certain number 0 : 
the күй major teaching field. An average of e 
Ades earned in these courses was COMP 


Sach subject. Professional educ? tion 
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courses were excluded from this average, as 
well as the first two years of basic courses re- 
quired of all freshmen and sophomores. А high 
grade point average indicated higher a c ademic 
achievement in the major teaching field. 


(4) Creative Effort Tests of Disposition Rigidity 
(Ref., 13. Also Appendix C 4) 


1. Reverse Strokes— This test consisted of 
two parts: In Part A the subject wrote the num- 
bers “2937” as many times as he could in one 
minute. In Part B, the subject wrote the same 
numbers for one minute, usinga reversed stroke, 
i.e., beginning at the bottom of Ше “77” and end- 
ing at the top of the *2". The score was the 
number of digits written correctly in Part A di- 
vided by the number of digits written correctly 
in Part В. Since a low score on this test indi- 
cated a higher degree of ability to overcome 
rigidity, these scores were reflected in order to 
be consistent with scores on the remaining vari- 
ables. 

2. Alphabet Test— This test consisted of 
three parts. In each part, the subject was to 
write as many letters as he could in the time al- 
lotted, as follows: 


Part A, the letters “арса” were 
to be written 30 seconds 
Part B, the letters “ABCD” were 


to be written 30 seconds 
Part C, the letters *taAbBcCdD" 
were to be written 30 seconds 


The final score was the number of letters writ- 
ten correctly in Part A plus Part B divided by 
twice the number written correctly in Part C. 
As in the Reverse Strokes Test, a low score in- 
dicated better performance; thereforethe scores 
made on this test were reflected in order to be 
consistent with the remainder of the data. 


(B) Battery of Alternation Tests of Flexibility 
(Ref., 38. Also Appendix C 3) 


This battery consisted of a total of nine tests. 
There were three tests in each of three areas: 
Numerical Speed, Verbal Abilities, and Percep- 
tualSpeed. In each area, the subject was re- 
quired to do first one task, thenanother 
task, and finally in the third test was re- 
quired to shift from one task to another 
inthe same test. This third test was con- 
sidered the measure of flexibility. А Thus 
three measures of flexibility were obtained from 


the battery of nine tests: 
1. Flexibility in Numerical Abilities 


9. Flexibility in Verbal Abilities 
3. Flexibility in Perceptual Speed 
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АП tests in the battery were speed tests and 
were administered in two parts so that estimates 
of test-retest reliabilities could be computed. 
Answers to the tests were recorded on IBM 
Sheets. Since many of the subjects were tested 
individually, a set of standard directions (Ap- 
pendix D) was used each time the tests were 
administered. 

The tests in each of the three areas are de- 
Scribed as follows: 


1. Two-Digit Numbers Test (Numerical Abili- 
ties) 


Each of the three tests in this area consisted 
of 120 items administered in two parts of 60 
items each. The time limit for each part was 
90 seconds. Тһе subject's task was to indicate 
on an IBM answer sheet whether answers to the 
problems as given were right or wrong. In the 
first test the subject responded to addition prob- 
lems and in the second test the 5 
ed to subtraction problems. 
sisted of mixed items 


2. Word Completion Tests 
— ————Peuon Tests 


This series consisted of 3 tests of 60 items 


administered in two parts 


а time limit of 90 seconds 
for each part. The Subject's task was to select 


the one letter from among five alternatives 
which formed a word when used witha given 
stem of three letters. None of the Stems were 
three letter words in and of themselves, 

In the first test in this Series, the Subject 
was to find the letter which, added to the front 
of the stem, made a complete word. Іп the зес- 
ond test, subject was required to find the letter 
which, added to the back of the Stem, made a 
complete word. In the third test, the tasks 
were mixed. The letters might go either in 
front or in back of the stem. Мо cues other 
than the stem itself were given as to whether 
the answer was an initial or final letter. 

A high score on test 3 was an indicator ora 
higher level of flexibility in the area of verbal 
abilities. 


3. Perceptual Speed Tests 


Each of these tests consisted of 60 items ad- 
ministered in two parts of 30 items each. The 
time limit for each part was two minutes. Each 
item consisted of a line of 30 capital block let- 
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ters. The subject's task was to count the number 
of times some particular letter appeared. This 
letter appeared from one to five times in each 
line. The number of times it occurred was en- 
tered directly on the IBM answer sheet. 

In the first test in this series, the subj ect 
counted the number of N’s appearing іп each line. 
In the second test, subject counted the number of 
W’s appearing in each line. Inthe third test, each 
line consisted of ‘‘M’s” “N’s” and “Ws”. At 
the beginning of each line, the letter to be count- 
ed was indicated in parenthesis. The require- 
ments of which letter to look for on each line 
were mixed. 

А high score on the third test was an indica- 
tion of a higher level of flexibility in the area of 
perceptual speed. 

Reliabilities of each of the tests in the battery 
of alternation tests is shown in Table IV. 

These reliability coefficients were computed 
on the basis of scores earned on two separately 
timed administrations of each of the nine tests. 
Thorndike (42) discusses methods for computing 
reliabilities of highly speeded tests, as distinct 
from “power” or level of performance tests with 
unlimited time. He points out that reliability es- 
timates for such speed tests should not be based 
on any division of a Single administration of the 
test. The two “part” scores of the single admin- 
istration would be very nearly identical and the 
resulting correlation between them would be mis- 
leadingly high. 


(6) Guilford- Zimmerman Temperament Survey 
(Appendix C 2) 


This questionnaire was developed to assess 
ten traits of personality. Scores on only five of 
these traits were used as measures of personal- 
ity in the present Study. These five were: Gen- 
eral Activity vs., Inactivity, Slowness; Restraint 
VS., Impulsiveness; Ascendance vs., Submissive- 


ness; Sociability vs., Shyness; Emotional Stabili- 
ty vs., Neuroticism. 


to each item by marking on an IBM answer sheet 
e following headings: “YES”, “9”, 


"NO". In the Present study, the Subjects re- 
Sponded to ай items on this inventory using eith- 
er the “YES” ог “КО” answer 
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TABLE V 


RELIABILITY ESTIMATES FOR FIVE TRAITS OF PERSONALITY MEASURED BY THE 
GUILFORD- ZIMMERMAN TEMPERAMENT SURVEY 


Split- Half Reliability 


Personality Odd-Even Reliability 
Trait Estimate Estimate 

G „70 (.82) „55 (ті) 

в . 64 (. 78) .48 (. 65) 

А .52 (. 68) .58 (.73) 

S „72 (. 84) . 66 (. 80) 

E .68 (. 81) . 69 (. 82) 
TABLE VI 


ON FIVE TRAITS OF PERSONALITY MEASURED BY 
ERMAN TEMPERAMENT SURVEY 
(N = 53) 


INTERCORRELATIONS ОҒ SCORES 
GUILFORD- ZIMM 


G 
R 009 
A 423 102 
8 430 038 Re 
172 429 
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the intercorrelations are low, indicating there 
is considerable unique contribution made by 
each trait. If all the intercorrelations had been 
high, the five separate scores could not have 
been used in this’study оп the grounds that only 
one personality trait was bei ng measure d. 
Since some of the intercorrelations were low, 
the scores were used as representing five traits 
ality. 
i епок traits assessed by this instrument 
are described below. These descriptions are 
quoted from the Manual of Instructions andInter- 
pretations for the Guilford- Zimmerman Temp- 
erament Survey (30). 


1. General Activity vs. Inactivity, Slowness 

A person scoring high on this trait usual ly 
likes a rapid pace of activities rather than a 
slow and deliberate pace. He prefers keeping 
in motion rather than pausing to rest; he has a 


liking for speed, hurrying and quickness of ac- 
tion. 


2. Restraint vs. Impulsiveness 

A person Scoring high on this trait is likely 
to be restrained and Serious in contrast to im- 
pulsive. Serious-mindedness, deliberateness, 
persistent effort and Self-control are empha- 
Sized by this trait, А person Scoring low is 


characterized as happy-go-lucky, carefree, im- 
pulsive, and excitement-loving. 


3. Ascendance ys, 
Persons with hig 
strong leadership h; 


Submissiveness 

h scores in this area have 
abits, enjoy Speaking with 
individuals and Speaking in public; they enjoy 
persuading others and being conspicuous. A 


high score indicates social boldness in contrast 
to submissiveness. 


4. Sociability vs. Shyness, Seclusiveness 
Persons with high Sociability scores have 
many friends and acquaintances, readily enter 
into conversations, like social activities, and 
Seek out social contacts. Тһе connotation for 
people scoring low in this category is ‘‘shy- 
ness” and *'seclusiveness". 
5. Emotional Stability vs. Neuroticism 
Persons with high score in this area usually 
are cheerful and optimistic and have evenness 
of moods, interests and energy. They are not 
excitable over slight distractions or annoyances, 
nor do they have perseveration of ideas and 
moods. 


(7) Measures of the Criteria of Teaching Suc- 
cess 


Before describing the measures employedas 
criteria, a brief discussion of certain terms will 
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be presented. 

The term ‘‘successful’’ as applied to the teach- 
er has been used in the present study rather than 
the term *'effective". The two terms often are, 
but need not be used synonymously. 

The term ‘‘effective’’ has been used to de- 
scribe a teacher who provides an atmosphe re 
which fosters desirable growth in pupils. Using 
this term implies (1) that agreement would have 
to be reached on what changes in pupils were de- 
Sirable, and (2) methods for assess ing them 
would have to be determined. 

Up to the present time, there is no adequate : 
system for evaluating a teacher's **effectiveness 
as defined above. 

Success as used in this study, is a broader 
term and involves the teacher as a friend and 
counselor of pupils and a member of a commun- 
ity and professional staff. To be successful in 
this broader sense a teacher must not only be 
able to provide an atmosphere which fosters de- 
Sirable growth in pupils but she must be accept- 
able to her peers, her pupils, the community 


and the principal of the Schoolin which she 
teaches. 


1. Practice Teaching Grade 

These grades are based on two semesters of 
practice teaching experience, one semester in 
the major field and one semester in the minor 
field. Grades are usually awarded опа бирегіог- 
Average-Inferior basis using an A, B, C grad- 
ing system. For purposes of statistical treat- 
ment, these grades were transformed to a value 
Scale of A = 13, A- = 12, В+= 11, В-10, В-- 
9, C+ = 8, С-7, С- = 


2. Placement Bureau Rating 


This rating was made by the Assistant Direc- 
tor of the Placement Bureau of the University of 
Wisconsin. The ratings were based on a variety 
of information collected by the Placement Bur- 
eau office: departmental rating of candidate, 
transcript, letters of recommendation, biograph- 
ical statement by candidate, scores on personal- 
ity and intelligence tests, and information ob- 
tained from Persona] interviews with each teach- 
ег. This information is compiled on one data 
Sheet for each candidate. 

The Placement Bureau official rated each 
teacher опа thirteen point scale: 1, 1-, 2+, 2 
2-, 3+, 3, 3-,... -to5. These ratings were 
transformed to a value scale of 1 = 13, 1- = 12, 
Яка ll; «id 22-9, St bons Bee ds 


, 


3. Principal’s M-Blank ван BE 
PE ng Form (Appe 
On this form the principal of er 

Was asked to list st “a ag 


December, 1956) 


Пүе-рошї Scale were: 1 = superior; 2- above 
iu 3 - average; 4 - below average; 5 - in- 
P ior. These ratings were transformed to the 
àme value scale as that used for the other two 
B. eun ratings: 1 = 13, 2-10, 3- 1, 4 = 4, 


Procedures Followed in Treatment of the Data 


Three criterion estimates and twenty meas- 
ures of certain teacher characteristics are the 
basic data for this study. The three criterion 
estimates are: rating by principal, rating by 
Placement Bureau office, and practice teaching 
grade. The set of twenty measures of teacher 
Characteristics consists of the following: 


1. Four are measures of preservice achieve- 
ment. 

2. Five are measures of personality traits. 

3. Two are measures of the disposition rigidity 
temperament factor obtained by administer- 
ing the creative effort tests. 

4. Three are measures of the flexibility tem p- 
erament factor obtained by administering the 
battery of alternation tests. 

5. Six of the measures were obtained from tests 
which were part of the battery of alternation 
tests. 

Two methods are used in analyzing these 
data: 


a group of good teach- 


1. Differences between : 
teachers, as defined 


ers and a group of average ' r 
by the three criterion estimates, are investigat- 


ed by means of a multivariate analysis of vari- 
ance technique (8). By this technique it is pos- 
ыле to determine whether the two groups 411- 
ег in any or all of three ways: an 
à. In terms of a sum of scores made: by indi- 
viduals on the twenty measures 
b. In terms of classes of measures Grenen 
vice achievement measures, temperame 
measures, and personality measures). 


m 2. Relationships between seven of the twenty 
boa reg of teacher characteristics and a com- 
Site of the three criterion estimates аге in- 


пейванеа by means of the canonical correlation 
od gi i . Seven vari- 
ables d Given by Hotelling (32, 33) пра 


е › Selected оп Ше basis of profile d 
e S found to exist between the group of good 
hers and the group of average teachers, are 
та ed in this study of relationships. nans 
ed or canonical correlation method was sele 
меніне it gives the solution for determining 
тан 5 to apply to each of the three crite rion. 
rig, 88 to combine them into а composite crite 
Metho The weighted composite obtained by this 
d is a general factor extracted from the 
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matrix of intercorrelations of the three crite- 
rion variables. As such, it is possible to de- 
scribe the factor, or composite, in terms of the 
relative contribution of the variables. 

Thus the advantage of a weighted composite is 
in being able to identify the variables associated 
with it. Holzinger (31), and Cumbee and Harris 
(19), have shown that a simple averaging ofa set 
of criterion ratings may not result in all the rat- 
ings being represented in the composite. Thata 
simple averaging of criterion estimates may not 
be feasible is also pointed out by the studies of 
Anderson (2) and Erickson (23). 

In brief, the procedures to be followed in 


treating the data are: 


1. Two groups of teachers will be formed by 
dividing the sample of forty-six into an upper 
half and a lower half on the basis ofallthree 
criterion estimates received by each teacher. 

2. Raw scores on the twenty measures will 
be standardized over both groups. 

3. A multivariate analysis of variance tech- 
nique will be applied as a test of significance of 
differences between the two groups of teachers. 

4. Certain variables will be selected from 
the twenty measures of teacher characteristics 
on the basis of the results of the analysis of var- 
iance. If the groups differ in terms of classes 
of variables, then classes of variables willbe se- 
lected for the further study of relationships. If 
the groups differ in terms of profile, then vari- 
ables which separate the groups the most willbe 
selected. 

5. The canonical correlation between a com- 
posite of the three criterion estimates and the 
selected measures of teacher characteristics 
will be computed. The weights to form the com- 
posite will be given by this computation. 


SECTION III 


ANALYSIS OF THE DATA—ANALYSIS OF VAR- 
IANCE TREATMENT 


IN THIS CHAPTER the analysis of the dataas 
treated by the multivariate analysis of variance 
technique will be presented. 

The primary purpose of the present study was 
to investigate differences between a group of good 
teachers and a group of average teachers in 
terms of certain measures of teacher character- 
istics. While some pre-service achievement 
measures were employed, the teacher cha г ас- 
teristics of most concern 1n the study were five 
personality traits and certain aspects of temper- 
ament as measured by objective tests. 

The analysis of possible group differences 
was made by а method proposed by Block, L e- 
vine and McNemar (8). This was a multivariate 
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analysis of variance design which permitted dif- 
ferences between the group of good teachers 
and the group of average teachers to be revealed 
in any or all of three ways: 


1. In terms of sums of scores for individuals; 

2. In terms of classes of variables (preservice 
achievement variables, personality variables, 
and temperament variables); 

3. In terms of a profile of group means on 
twenty variables. 


Forty-six women teachers were the subjects 
in the investigation. This Sample was divided 
into two equal groups of twenty-three members 
each on the basis of the three criterion ratings. 
Those teachers who received the highest rat- 
ings were assigned to the upper half; those who 
received the lowest ratings were assignedto the 
lower half. АП three ratings received by each 
subject were taken into consideration in Separ- 
ating the sample into the two groups. 

Table VII shows the combinations of the three 


From Table VII it is noted that all teachers 
in the upper group received ratings of superior 
ог above average from all three raters. The 
range in ratings received by any one person in 
this group is from 1 to 2. There appears to be 
agreement among the various raters that these 
persons are superior and above average teach- 
ers. Inthe present Study, this £roup is desig- 
nated the group of **good"' teachers and is re- 
ferred to in Subsequent tables by the code sym- 
bol “Group I.” 

Table VII shows there is less un iformity 
among the ratings assigned the teachers in the 
lower group. The ranges in ratings received 
by any one person in this group were from 1 to 
3, 2 to 3, 2 to 5, 3 to 4, and 3 to 5. One per- 
Son in the lower group received one rating of su- 
perior and two ratings of average; ten persons 
received one rating of above average with two 
ratings of average, below average or inferior. 
Twelve members of the lower group are clear- 
ly average or below average teachers in terms 
of all three ratings. The lower half of the sam- 

ple is designated the group of “ауегаве” teach. 
ers in the analysis which follows. The code 
symbol “Group II” is used to refer to this low- 
er group. 

The raw scores on each variable were 
summed over both groups. Тһе meanandstand- 
ard deviation of the distribution for each vari- 
able were computed. These means and stand- 
ard deviations were then used in converting the 
raw scores to standard scores. Raw scores 
and standard scores for all variables are shown 
in Appendices E and F. 
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Standardizing the scores resulted in each of 
the twenty distributions having a mean of zero 
and a standard deviation of 1.0. Thus the var- 
lance for each variable was equalized. 

Equalizing the variance in this way eliminated 
the variables as a source of variance. When the 
raw scores were converted to standard scores, 
the sum of scores on each variable became zero. 
Since these sums are the basis for computing the 
mean square deviation for variables, it is obvi- 
ous that variables as a Source of variance would 
be eliminated. 

The standard scores for the two disposition 
rigidity measures, the Reverse Strokes test and 
the Alphabets test, were reflected. As indicated 
earlier in this Study, a low score on these two 
tests indicated better performance while a h igh 
Score on the remaining eighteen variables indi- 


П, andthe analysis of the group means on the sev- 
eral variables, Group I and Group II, is present- 
ed in Table VIII. The significance of all Е ratios 


found in this study was tested by tables in Ed- 
wards (22), 


el. The hypothesis that 


fer in their grand means, i, €., the means given 
within each group, is 


89 is significant at 
The hypothesis that the groups do 
е Profile of scores is therefore 


^d 
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ember, 1956) JONES 


TABLE VII 


COMBINATIONS OF CRITERION RATINGS ASSIGNED THE FORTY-SIX 
TEACHERS BY THREE RATERS 


Number of teachers who 
received each combi- 
nation of ratings 


Combinations of the 3 
ratings assigned to 
each teacher 


1,1,1 5 
1,1;2 1 
1,2,2 12 
29,2 5 
1,8,8 1 
2,3,3 9 
2,4,5 1 
3,3,3 10 
3,4,3 1 
8 5.3 1 

46 


Total Number 


TABLE VIII 


VARIANCE TABLE FOR ANALYSIS OF GRAND MEANS, GROUP I AND GROUP I, AND 
ANALYSIS OF GROUP MEANS ON THE SEVERAL 


VARIABLES, GROUP I AND GROUP II 


Mean 


Sum of 
Source Squares d.f. Square F 
0 
Variabl 0 19 
Groups + 45. 3146 E: ые T 
Individuals 178.4694 AE Ho fees ната 
‚6281 

Group x Variables 30.9937 "E. 0. 1954 2.0469* 
Individuals x Variables 664. 9632 

Total 919. 6160 919 


"Significant beyond the 1% level. 
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of 
Eu nds were the same for each group on 
for the ime le. Thus the profiles were different 
Positive о groups only in terms of their sign, 
Hen m M negative. The important considera- 
the dista: erpreting the profile differences was 
of the у nce the groups were separated on each 
Si ariables. 
ean dia significant difference was found be- 
Sons ax e groups in terms of profiles, compari- 
ers indi made between the group of good teach- 
he group of average teachers in terms 


of t 
en twenty measures. These comparisons 


Ws There appears to be very little difference 
ween the good teachers as compared to the 
average teachers in terms of emotional stability 
as measured by the Guilford- Zimmerman Tem- 
Perament Survey. 

2. There does appear to be a great deal of 
difference between good teachers and average 
teachers in terms of the General Activity per- 
sonality trait. 

3. Good teachers in comparison to average 
teachers tend to differ in certain other respects: 
professional grade point average, major teach- 
ing field grade point average, flexibility in nu- 
merical abilities and the disposition rigidity 
temperament factor as measured by the Alpha- 
bets Test. 


ic Having found the profile accounted for signif- 
а ant differences between the two groups, the 
ata were further analyzed to determine wheth- 
с Classes of variables (preservice achievement 
аа ез, personality variables, and temp е ra- 
Ment variables) would account for sign ificant 


а 
ifferences between Ше groups- 
lem involved separ- 


source of variation 
e of varia- 


а hu ааа into two parts: betwe 
| and within classes variation. i 
alysis amounted to an extension of the first an- 
L $ of variance. 
arian rection terms were computed with the 
les now considered classes of variables. 


Variable] was comprised of the 4 academ- 
Vani ic measures. А 
Ariable ПО was comprised of the 11 objec- 


f temperament. 


tive measures O 
e 5 person- 


Vari 
riable Ш was comprised of th 
ality measures. 


Thi 

е : + 

teracti Sums now required for computing the 107 
"Оп terms were: 


1 
H Fo 
T groups by between classes — 
the UD sums on all variables in еас 
е three classes (resulting in à 


h of 
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matrix) 

2. For individuals by between classes— 
Sums of scores made by individuals on 
all variables in each of the three clas- 
ses (resulting in a 3 x 23 matrix) 


An individuals by between classes interaction 
term was computed separately for Group I and 
Group II, and the variances tested for homogen- 
eity before pooling. 

The group by between classes interaction was 
subtracted from the total group by variable inter- 
action (shown in Table VIII) to give the groups 
by within classes interaction. Individuals by 
within classes interaction was obtained by a sim- 
ilar method. 

A summary of the basic analysis of variance 
and the extension which analyzes classes of var- 
iables as a source of variation, is presented in 
Table IX. 

The appropriate test for determining whether 
individuals vary significantly with classes of var- 
iables is the mean square for individuals by be- 
tween classes interaction divided by the mean 
square for individuals by within classes. This 
ratio is 2. 72. For 88 and 748 degrees of ігее- 
dom an F of 1.49 is significant at the 1% level 
The hypothesis of no difference is rejected. 
Therefore, individuals perform better on som e 
classes of variables than on others. 

The ratio of the mean square for groups by 
between classes interactionover the mean square 
for individuals by within classes is the appro- 
priate test for determining whether groups differ 
in terms of classes of variables. "This ratio is 
1.09. For 2 and 748 degrees of freedom ап Е ra- 
tio of 4. 62 is significant at the 1% level. The hy- 
pothesis that the groups do not differ in terms of 
classes of variables is accepted. Therefore, 
the interaction of groups and classes of vari- 
ables is not significant. 

The results of these last two tests of signifi- 
indicate that while there is some evidence 
individuals vary in terms of classes of variables, 
there is no evidence the two groups differ in 
terms of classes of variables. 


cance 


Summary of Analysis of Variance Treatment of 


pata 
Significant differences were found to exist 
between the group of good teachers and the group 
of average teachers in two Ways: 


f the sum of scores made by indi- 


the twenty measures; 
f the profile of scores. 


1. In terms 0 
viduals on 
2. In terms 0 


ence individuals varied 
riables but there was 
ffered in terms of clas- 


There was some evid 
іп terms of classes of val 
no evidence the groups di 
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pM ins of the analysis of variance, 
certain conclusions are warranted relative to 
good and average teachers as defined by ratings 
assigned by principals, Placement Bureau of- 
ficial and practice teaching supervisor: 


1. There is very little difference between 
good teachers and average teachers in terms of 
emotional stability as measured by the Guilford- 
Zimmerman Temperament Survey. 

2. Among the fivepersonality traits 
measures, the greatest difference between good 
and average teachers is in terms of the General 
Activity personality trait. There is some dif- 
ference between the two groups in terms of the 
Sociability and Ascendance traits as measured 
by the Guilford- Zinmerman Temperament Sur- 

vey. 

г Good teachers in comparison to average 
teachers tend to differ in certain other respects: 
professional grade point average, major teach- 

ing field grade point average, flexibility in nu- 
merical abilities, and the disposition rigidity 
temperament factor as measured by the Alpha- 
bets test. 


SECTION IV 


ANALYSIS OF THE DATA—CANONICAL COR- 
RELATION TREATMENT 


presented in this section. 

Following the analysis of &roup differences 
discussed in Section III, а further investigation 
of the data was made to determine the relation- 
Ships between seven of the measures ofteacher 
characteristics and a composite of the criterion 
ratings. 

The seven measures employed in the canoni- 
cal correlation analysis were Selected from the 
original twenty measures on the basis of thepro- 
file differences found to exist between thegroup 
of good teachers and the group of average teach- 
ers. These profiles (Figure 1) showthe amount 
of separation between the groups on each of the 
twenty measures. The seven variableson which 
the groups were separated the most were Select- 
ed to be included in the study of relationships re- 
ported in this section. | 

These seven variables were: (1) profession- 
al grade point average; (2) major teaching field 
grade point average; (3) the Alphabets test (dis- 
position rigidity measure); (4) Two-digit num- 
bers, Addition; (5) Two-digit number, Subtrac- 
tion; (6) Two-digit number, Mixed (flexibility in 
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the numerical area); and (7) the General Activity 
personality trait. | 

The basic data for Ше canonical correlation 
analysis were the seven variables listed above 
and the three criterion estimates: Principal's 
M-Blank rating, practice teaching grade and 
Placement Bureau rating. The extreme scores, 
ranges, means and standard deviations of the 
distributions of scores on these ten variables 
are shown in Table X, preceding page. 

4 model of the canonical correlation method, 
given by Thomson (60), was followed in the study 
of relationships between the seven measures of 
teacher characteristics and a composite of the 
three criterion estimates. 

Before presenting the canonical correlation 
analysis, a brief description of the method and 
a statement of the procedures followed will be 
given. 

The canonical correlation is a multiple corre- 
lation between two sets of weighted variables. 
The classical multiple correlation is the situa- 
tion in which a set of weighted variables is com- 
bined to predict only one criterion estimate. 
This criterion to be predicted in the classical 
multiple correlation may be one rating or a com- 
bination of ratings equally weighted to form one 
criterion score. The distinction between the 
classical multiple correlation and the canonical 
correlation is that in the Solution for the canoni- 
cal correlation, weights are found to apply to the 
Several criterion measures to form a composite. 


In brief, the procedures followed in this anal- 
ysis were: 


l. The weights for the criterion variables 
and the canonical Correlation between the two 
weighted batteries were found by Solving the de- 
terminantal equation given by Hotelling (32, 33). 

2. Weights for the seven measures of teach- 
ег characteristics were found by using the usual 
regression procedures in which the seven meas- 


ures were predicting the weighted composite of 
Criterion ratings. 


А preliminary step in the treatment of the da- 
Was to compute Pearson product moment co- 
efficients of Correlation as follows: 


1. Among the three 
2. Among the se 
acteristics; 


3. Between each of the seven measures and each 
Criterion Variable, 


Criterion variables; 
Ven measures of teacher char- 


These correlations were then 
byten matrix. This matri 
and the various part 
in Figure 2. 


arranged in a ten 
X was partitioned 
$ Symbolized as shown 
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Figure 2. Symbols Used to Represent Sets of Correlations 


The а matrix represented inter 


correlations among the criterion variables. 


The B matrix repre- 
е seven measures of teacher 
sented correlations of each of the 


The C matrix rep re- 
The CT matrix was 


own in Table XI, and X is the 


This root is the square of the canonical 
correlation, ог Rë. 


The inverse of B was computed, and after the appropriate 
CTB-1C were found. These two 


multiplications the values in the matrix 
matrices are presented in Table ХП and Table Хш. 
The matrix CTB-1C was substituted in the equation CTB- 


1С-ХА-0аз follows: 


ХА 


. 326642 . 332436 .181567 


. 332436 .486724 - 391615 


. 181567 . 391615 - 406062 


The value for X, or the root for this determin 


t antal equation, was found by trial and error, first taking 
for X the square of the largest correlation among the correlations іп C and working upward until the 
sign changed, then interpolating. Following this procedure, 


Trial X = .615505 gave 


-.288863 41.022222 1.022151 


- 
4.022222  -.128781 41.004462 (minus) 


£N = -.007614 
4.022151 4.004462 -.209443 


ge но о оо з 
— 


ү 
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Trial > = . 496505 gave 


4.169863 4.082198 +. 052972 
(plus) 


4.082198 -.009781 +. 079313 № = + 000411 


4.052972 4.079313 -. 090443 


e root of this value was ‚134, which is the canonical 


Int i 
erpolating, X was found to be . 538456. The squar 
set of seven measures of teacher char- 


correlati š: 
а чели between Ше set of weighted criterion variables and the 
The sta š 
ndard error for this canonical correlation is 1 or .17. Since the obtained correl 
tion is greater than two and half t th ма 73 
is signifi and one-half times ше standard error it can b 
significantly different from zero (43). n be concluded the true value for Rc 
e found by solving equation [СТв-1С - an Е 


Next i 
» the weights for the criterion variables wer 
У 
(2 


-0 


un 
der the restriction that ^ = . 538456. 


The val 
ues found by solving this equation with > = . 5384 were: 


-.21184 +. 061054 +. 042107 
+. 061054 -. 051732 +. 052926 ZS = -. 00027216 


+. 042107 +.052926 -. 132394 


omputed. The ratio in any of the three rows of cofactors were 


The c 
е cofactors of these values were С 
The cofactors were: 


the wei 
ights for the criterion variables. 


+. 00404785 + 010351174 + 00540962 
+. 01031174 +. 02626990 +. 01378127 
+. 00540962 + 01378127 +.00722997 


.3925 : 1.000 25246. These values аге the 
" characteristics were found by the following sequence of 
trix using the weights found, (2) normalizing the vector now repre- 
and (3) performing the usual regression calculations with 


mposite of the criterion variables. 
d weights, 


walpa eo in any of these rows of cofactors was: 
eights аа criterion variables. 
Operations; Or the seven measures 
Senting the (1) condensing Ше А та [ 
е 5еуеп Set of criterion intercorrelations, 
he A variables predicting the normalized со 
matrix was condensed, using the calculate 


of teache 


as follows: 


.3925 
1.0000 
.5246 
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Тһе condensed values for the А, C and CT ша- 
trices were: 
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These condensed values were normalized, 
using the reciprocal of the Square root of 2.5915 
as a multiplier on each of the values, 


seven measures of teacher characteri 
the composite, The Correlations of t 
measures with the composite criterio nare 
shown in Table XIV. 
The significance of these correlations was 
tested by the method given in McNemar (43). 
The standard error with three degrees of free. 
dom was .1525. The obtained correlation was 


Summary of Analysis of Data— Canonica] Corre- 
lation Treatment 
— с вәлпепс 


Relationships between а weighted composite 
of three criterion ratings and a weighted batter 
of seven measures of teacher characterj Stics 
were investigated by Hotelling’s Canonical сог- 
relation method. Results of this analysis were: 


1. The canonical correlation bet ween the 
weighted composite and the weighted battery of 
seven measures of teacher characteristics was 
.73. This correlation was Significant at the 1% 
& the criterion estimates are combined 
according to the weights found and when a linear 
combination of the seven measures is made us- 
ing the weights found, it is possible to predict 

hing success from these data in a limited 
ея sense. Prediction from these data is limit- 
ү cause Ше measures of teacher characteris- 
m шора in this study were obtained at the 
a the teachers were already on the job. The 
ые теазигед шауһауе developedas 

с 


а result of Ше teachi 
not be present in рег 


2. Weights for the 
were: 


Practice 
Placement B 
lacement M-Blank rating +0. 525 


і ірһі 
ng experiences and mig 
Sons who had not yet taught. 


three criterion estimates 


teaching grade +0. 392 


ureau rating +1. 000 


measures of teacher charac- 
teristics are Signific 


antly correlated with the 


weighted composite Criterion. Of these six, 


it number, Addition; 

personality trait 
One objective 

ure of flexibility inn 


it. 


of disposition rigidity, is not. This measure of 


SE 


5 y had the lowest correlation 
With the Composite, 
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SUMMARy AND CONCLUSIONS 


Statement of the Problem 
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TABLE EN 


CORRELATION OF EACH OF THE SEVEN MEASURES OF TEACHER 
CHARACTERISTICS WITH THE COMPOSITE CRITERION 


-———— 


Professional Grade Point Average .916* 
Major Teaching Field Grade Point Average „524 
Reverse Strokes Test (Disposition Rigidity) .210 
Two-digit Numbers, Addition . 484* 
Two-digit Numbers, Subtraction .383* 
Two-digit Numbers, Mixed (Flexibility) . 418* 
General Activity Personality Trait „461 
*Significant at the 1% level. 
TABLE XV 
WEIGHTS FOR EACH OF THE SEVEN M EASURESOF 
TEACHER CHARACTERISTICS 
2 Professional Grade Point Average in" 
| Major Teaching Field Grade Point Average 9и" 
Reverse Strokes (Disposition Rigidity) apri 
y Two-digit Numbers, Addition nid 
| Two-digit Numbers, Subtraction proe 
ү Two-digit Numbers, Mixed (Flexibility) pe 
4.2716 


| ; 
| General Activity Personality Trait 
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x8IP' SI8I + (Аұппатхәтя) рехтиг "зледштм ийр-омт, 
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IAX ATAVL 
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А secondary purpose of the study was to in- 
vestigate the relationships between a composite 
of three ratings of teaching success and certain 
measures of preservice achievement, tem per- 
ament and personality. 


Measures Employed in the Study 


Twenty-three measures were employed in 
the study. These may be classified into four 
groups as follows: 


1. Criterion estimates of teaching success 
(1) Practice teaching grade 
(2) Placement Bureau rating 
(3) Principal's M-Blank rating reported on 
Wisconsin Adaptation of M-Blank 


2. Measures of preservice achievement. These 
measures were obtained from University of 
Wisconsin records. The four prese rvice 
measures were: 

(1) Quantitative score (expressed in Percen- 
tile Rank) American Council on Education 
Psychological Examination. | 
Linguistic score (expressed іп Percentile 
Rank), American Council on E du cation 

(3) Psychological Examination. 
Professional grade point average 
in preservice education courses: Educa- 
tion 73, 74, and 75. 


earned 


4) Grade point average earned in cours e? 
taken in the major teaching field. 

" Objective measures of temperament. These 
Objective tests of temperament were SP eed 
tests designed to measure specific behavior 
гі Persons in some standard situation, rath- 

r than tests requiring self-evaluation оп. e 
oe of the subject, Two kinds of objective 
ests were employed: 
Creative effort tests developed by Cattell 
as measures of disposition rigidity 
E joie Strokes test 
- Alphab 
(2) Battery of ee tests developed by 
г leemeier and Dudek аз measures of flex- 
ibility in three areas 
а. Numerical speed 
b. Verbal abilities 
с. Perceptual speed 
4. 


Measures of personality. This group was 
опровед of measures of five traits obtained 
У administering the Guilford- Zi m m er man 


Temperament Survey. These five traits were 


(1) General Activity vs. Inactivity, Slowness 
) Restraint vs. Impulsiveness 
4) нема vs. Submissiveness 
Ociability vs. Shyness, Seclusiveness 
Emotional Stability vs. Neuroticism 
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Design of Ше Study 


Forty-six women teachers in their second, 
third or fourth year of teaching in Wisconsin 
secondary schools were the subjects for this 
study. 

This group of forty-six teachers was divided 
into an upper half and a lower half on the basis 
of the three criterion estimates. The upper 
half was designated as Group I, good teachers, 
and the lower half was designated as Group Il, 
average teachers. 

Differences between these two groups in 
terms of certain measures of preservice achieve- 
ment, temperament and personality were inves- 
tigated by а multivariate analysis of variance 
technique. 

Following this analysis of group differences, 
a study of relationships between a composite of 
the three criterion ratings and seven of the twenty 
measures of teacher characteristics was made 
by a canonical correlation method. 


Results of the Study 


There was a significant difference between 
the group of good teachers and the group of aver- 
age teachers in terms of the profile of group 
means on the twenty measures of teacher char- 
acteristics. The profile differences showed the 
variables on which the groups differed the most 
were: (1) professional grade point average, (2) 
major teaching field grade pointaverage, (3) flex- 
ibility in numerical abilities, (4) disposition rig- 
idity as measured by the Alphabets test, (5) the 
General Activity personality trait. 

There was no significant difference between 
the group of good teachers and the group ofaver- 
age teachers in terms of classes of variables 
(preservice achievement variables, tempera- 
ment variables and personality variables). 

A significant relationship (canonical correla- 
tion of . 73) was found between а weighted сош- 
of the three criterion estimates and a 
weighted combination of seven measures of pre- 
service achievement, temperament and person- 
ality. In the weighted composite criterion, 
greater emphasis was placed on the Plac ement 
Bureau rating and Principal's M-Blank rating 
than on the practice teaching grade. In the com- 
bination of seven measures of teacher character- 
istics, greater emphasis was placed on the ma- 
jor teaching field grade point average; two-digit 
numbers, addition; and the General Activity per- 
sonality trait. 

Six of the seven measures of teacher charac- 
teristics employed in the canonical correlation 
analysis were significantly correlated with the 
composite criterion. These six measures were 
(1) professional grade point average, (2) major 
teaching field grade point average, (3) two-digit 


posite 
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rs, addition, (4) two-digit numbers, sub- 
ода (5) two-digit numbers, mixed, апа (6) 
General Activity trait as measured by the Guil- 
ford- Zimmerman Temperament Sur vey. Of 
these six measures, those which corr elated 
highest with the composite were the two grade 
point averages; General Activity personal ity 
trait; two-digit numbers, addition; and two-dig- 
it numbers, mixed (flexibility in the area of nu- 
merical abilities). 


Conclusions 
АННО: 


The significant differences found between 
the two groups of teachers seem to indicate that 


И one wishes to make interpretations from 


the objective measures of temperament and {гот 
the Guilford- Zimmerma 

employed in this Study, itis 
good teachers with average 
by the three Criteria) in cer 


measures and the weighted Composite point out 
teacher characteristics which it might be prof- 
itable to investigate in further Studies of the 
prediction of teaching success. 

In further studies in this area, it would ар- 
pear profitable to more thoroughly explore a 
greater number of temperament traits as meas- 
ured by objective tests. 

Further studies Should be made along the 
same general lines, using different samples, to 
validate the relationships found in the presentin- 


vestigation. 
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ing two sections. 


Simultaneous Examination and Method 


Analysis 


The data for this illustration were taken from 
(4) which was concerned with evaluating the ef- 
fects of a high school Solid Geometry prerequi- 
site for students in college engineering drawing 
classes. There were three “methods” (M-3) in- 
seare designated by the type of stu- 


THE 
trate шет purpose of this paper is to illus- 
internal con putations involved in estimating the 
of an и of the responses to items 
different e nation which was given under several 
dition опий conditions with each con- 
Purpose De rie different subjects. The second 
and external shoy how to estimate the internal 
i consistency of responses to the 


items of і 
to the same асы which was administered volved. The 
Oretical rondes jects at different times. Thethe- dents who were enrolled in one of three groups. 
opments of these two problems The three groups were: 
Experimental Group—Students who en tered 


the College of Engineering with a deficiency in 

high school Solid Geometry and who enrolled in 

a college course called Engineering Drawing - 4 

prior to taking Solid Geometry in college. 
Regular Group—Students who entered the Col- 

lege of Engineering without a deficiency in high 

school Solid Geometry and who enrolled in Engin- 


eering Drawing - 4. 
Control Group — Students who entered the Col- 
tha deficiency in high 


lege of Engineering wi 
school Solid Geometry and who enrolled in Solid 
Geometry in college prior to enrolling in Engin- 


eering Drawing - 


wer 
The Coen references Бап б, 
ures the ss a of internal consistency meas- 
to the items of class correlation of the responses 
Possess very inn examination. If the responses 
individual diff е internal consistency, then few 
Subjects to m can be detected among the 
dentally us om the examination is given. Inci- 
за statistic Coefficient of internal C onsistency 
9r more Ж. which may be usedin comparing two 
ет of па nations without regard to Шепиш- 
Consist S of each. А coefficient of ext e rnal 
tion but iti псу is also an intra-class corre la- 
Sponses t measures the consistency of the ге- 
о the items or scores made by the same 


Subjects i 
Е x : 
i in different administrations. Ап Ge multiple-choice examination 


` А five-choice, 
ms (1 = 50) was givento each 


lon which 1 ge 
ent of ch is associated with a small coeffici- г 
exter: i imi isting of fifty ite 
val nal consiste ld be of limited consisting р 
че for identifying individual differences since of the individuals in each of the groups after they 
had completed Engineering Drawing - 4. The 
examination concerned problems 


items of the 
typically 4550 
The responses 


е sc 

чеһ с: of an individual would vary nearly 25 

e Scores the repeated administrations aS would 
es of all individuals in any admini Btra- 


ciated with orthographic projection. 
to the items were scored dichoto- 


tion 
tive In effect then i t stable rela- 
to : , а score is пої 820, rrect responses were SCO 
the time or conditions of the administr- mowly Gaay were огой 0. Total =, 
е & аге {otal number of correct respon- 


Нод 
о р 
by о Же e кадап and to Ше scores, AY Edhl.eq 
of ividuals. i i 1 Е с 
але determ ination Е. шанын g = "Ai ва 1680. Coc iran (2) has shown thatanalysis 

external consistency are given in theol- .... res are suitable for use with 


and are in no чау fficial; nor are they to be 
fidld Activity or Bureau of Per- 


*The орі | 
со. Opinions expressed аге solely thosé оѓейе we. шн асына 
ебе, Nava Personne zm 


Опа 
tonne d as representing those of the 
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ta scored in this manner А 
> The parametric form of a response toan item 
(i) by a subject (s) in one of the groups (m) is in- 
dicated by 


y(ims) = Е + t(i) + n(m) + o(s) + Ө(іш) + ср (is) 
1=1,...,1; m=1,...,M; 5 -1,...,S(m) 


where € represents the general effect, 1 (1) the 
effect of the ith item, p(m) the effect of the mth 
method, @(im) the effect of the (im)th interaction 
and (15) the effect of the (is)th interaction. Itis 
further assumed that each response is associat- 
ed with a variance, 02, and that the responses 
for a given subject are correlated to the degree 
р(Т) which is called the coefficient of interna] 
consistency. If the examination consists of 
items which are not mutually intra-correlated to 
the same degree, the estimate of P(I) will be a 


parscript are random variables. 
The data are Summarized as sums and sums 


The la yout, 
Which is basic to the determination of the numer- 


group, we total and record the 175 for individu- 
als across the rows we Obtain the tota] s согев, 
If we total Ше 175 vertically down the columns 
we obtain the item totals. For each group we 


responses within the rectangle and to find the 
sum of squares of the item totals and total scores, 
For dichotomously scored (0, 1) items, the sums 
of squares of the responses is equal to their sum, 
Additionally, the totals of the same items of each 
group are added together and the Sum of the 
squares of these totals (2046044) is found. The 
calculation formulas given in Part П of Table I 
are then evaluated for the data given in Part I. 
The summary of the analysis of variance is giv- 
en at the top of Table II. 
The 95% confidence interval (С.І. ) ог Т) 
which is а correlational property of the тевроп- 
Ше items and, also, the index of internal 
Bes D ncy, p(H), will now be evaluated. The 
tona se (Н) is a property of the entire exa min- 
quantity М e it is Ше Spearman-Brown function of 
the number of items, І, and Б), thus p(H) = 
the num i (|. А small p(H) would indicate 
Io(D/[ 1 +I яке the responses of а subject to 
pepe the examination does not greatly 
the I 1 
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facilitate the detection of individual diff erences. 
The information given by the estimate of p(H) 8 
of the same type as that provided by “‘split-half 
and other similar types of reliability coefficients 
if the Spearman-Brown formula has been used in 


class correlations should be used instead of prod- 
uct-moment correlations since the Spearman- 
Brown formula assumes that the variances of the 
subjects’ scores are equal. The procedure given 
here has the advantage of being independent of any 
type of “split” made on the items to form the sub- 
tests. In some cases an unfortunate “ври?” may 
lead to a misleading index of internal consistency. 
, FLU] = 
F[ 345, 16905;.975] = 1.17 апа ЕГІ = 1/F[ 16905, 
345;. 975] = 1/1.20 = - 833. From Ше yan ianea 
column of Table II the statistic F[o] = .9330/.182 
= 5.12 is determined. Using equation 13 of (5) 
the interval is calculated to be 

5.12 - 1.17 


(1) — 5.12-.833 
5-12 +49(.833) > РІ) > ене 
-09 > pil) > .06, 


where 1-1 = 49. Since the С.1. does not include 

zero, the hypothesis that P(I) = 0 (or р(Н) = 0) 18 
rejected at the . 05 leve] of confidence. The point 
estimate of p(I) is found by substituting 1.00 for 
1.17 on-the right side of (1). Thereby, г(1)=. 08. 
The 95% С.І. for Р(Н) is 


(2) 1-.833/5. 12 > р(Н) > 1-1.17/5.12 


84 > p(H) > 2.17 


Тіе Point estimate of P(H) is also found by substi- 
tuting 1.00 for 1.17 but this is done now on the 
a Side of (2). The quantity r(H) is found to be 


The coefficient of internal consistency, r(I)- 
8, for these data 1 


5 rror of measurement (S. E. M.), 
16 (1-р( )| , expressed in terms of total score 
units is estimated by multiplying the va riance 
of E[ IS] by I = 50 and then taking the square root 
of that product. ‘Thus the n: E. M. -/40(1822) 
св. 02. Also the standard deviation of the sub- 


the square root of 
that product. The s.p o Y SO 930) 9330) = 6.83. Sep- 
arate evaluations of the г(1)%, r(H)’s, S.E.M.’ 


"P have also been made 
and are presented at the bottom of Table H. It 


шау be seen that they exhibit remarkable agree- 
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TABLE I 


SUMS, SUMS OF SQUARES AND ANALYSIS OF VARIANCE CALCULATIONS FOR 
THE DATA TAKEN FROM REFERENCE (4) 


1. 


5 
"ms and Sums of Squares 


5 Group 
?SCription Symbol Experimental Regular Сопіго1 
Subject ymbo. xp Total 
s 
м S(m) 60) «51 5(2)-274 8(3)-23 5-34 
m of 
М Responses zz y(ims) 1216 1426 700 9342 
“5.0 18 
8 Í Responses — 1216 7426 700 9342 
š 8, is 
9f Item Totals ms)? 36390 1291838 11268 2046044* 
is z[z y(ims)] ке: 
` Š. of 165 
Total Scores z[z y(ims)] 31460 213534 22658 267652 
51 


This 
n number corresponds to the numerator of А given below. 
` Analvsi 

У515 of Variance Calculations 


Ña 
=> | 
і ҮЗЕ y(ims)]?/s = 2046044/348 = 5879. 4368 
B. 
= 55 | 
en Zy(ims)] */Stm) = 36390 , 1291838 , 11268 . 5940. 0715 
с. 5 274 2 
з | : 
ш 22 y(ims)]  /IS(m) = (1216)? , (1420) , (100)? 5031.1693 


D. 
` Уу А 
mal ® y(ms)]?/1 = 267652/50 = 5353. 0400 
с. 
SESS ss 
ims y(ims)]?/IS = (9342)? /(50)(348) = 5015. 6876 
т. 
«5 
im 342. 0000 


= А 
E y*(ims) = 7426 + 1216 + 700 = 9 
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TABLE П 


ANALYSIS OF VARIANCE OF THE y(ims) AND SUMMARY STATISTICS BY GROUPS FOR THE DATA 
TAKEN FROM REFERENCE (4) 


I. Analysis of Variance of the y(ims) 


Source of Degrees of 

Variation Freedom Sum of Squares Variance Е 
НІ IM];8(im) = 0 ГІМІ- 93 B-A-C«G - 45.1590 . 4608 2.53** 
Е[ 15] ГІ S-M = 16905 T 


T-D - 3988. 9600 
Но); Ë= 0 1 G 


= 5015. 6876 
НІМ); щш) = 0 Mi = 2 с-с = 15.4817 7.7409 8. 30** 
Е[ 5] SM = 


= 345 D-C - 321.8707 . 9330 
Inter-Subject Total S - 848 D 


IL. Summary Statistics by Groups 


Group 
Statistic Experimenta] Regular 


Control Composite 
Items 50 50 


5 

Subjects 51 274 às Kk 
Means 23.84 27.10 30.43 26.84 
r(I) . 08 .07 111 108 
г(Н) 81 „80 186 “ій 
8.Е.М. 3.04 3.02 2.91 3.02 
S. D. (Scores) 7.02 6.71 7.84 6.83 
Mean Item Diff. .48 .54 . 61 ý 54 
S.D. (Item Diff.) .23 .23 


.24 123 
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ment from group to group. 
men interesting to note from Table П that 
and 5. Some interaction betweenthe items 
Some нА cn (Е = 2.53**). This means that 
ñ t ems are more difficult for some groups 
Strai СНЕ, . This tends to complicate a 
method orward interpretation of the item and 
acting Залы The identification of the inter- 
ever 165 Will not be undertaken here. How- 
that te ну of the data leads to a judgment 
о the =: interaction effects are small compa r ed 
Seems ep of group differences. There 
dificulti be little doubt that a difference in the 
6. тенк) 5 of the items has been detected, (Е = 
26. 84/50 and that the average difficulty, 
though the « 54, seems quite satisfactory al- 
ҮТ Standard deviation of Ше difficulties, 
Standard 348 2.23, is quite large. This same 
Вгоцра deviation prevails approximately for all 
Cordin though the average difficulties vary ас- 
he diffi o the group means (. 48, 54, and . 61). 
re um values of the items for each group 
is a| E variable although the average difficulty 
ог psych 50 which is а value often recommended 
he рз0пеігіс examinations. 
Нм); Ypothesis of equality of the group effects, 
$ Қаш) = 0, was rejected, (F = 8.30**). The 


Brou 
P means are given at the bottom of Table п. 


uncan' 
Sach ot s multiple range test (a = .05) shows that 
ificantly 


from б е group means differs sign 
author чо Other group mean. According 10 the 
Point dif (4) the approximate three point and six 
ans г erentials which exist between the group 
tical dif ергезепів a practical as well as а statis- 
at hayu дер; The evidence thus indicates 
Белегдуіпе had a course in Solid Geometry 1° 
lal to those taking Engineering prawing—4- 


The 

D а 

Con Stermination of External and Internal 
#888 


The і | 
Woulq illustrations of the calculations which 
the coeffi- 


cients се Involved in the evaluation of 
COrding ехіегпа] and internal consistency, à C- 
ampie® (0 (6) will now be described. For thee" 
М anc -- Collected for Ше purpose of develop- 
i Ange Rooting a proficiency test for 2 Tactical 
AA i Thee (TRR) operator (1) will be апа- 
ner equi е TRR is an instrument used, with 
Ска d'iPments, in making anti-submarine at- 


and; 
Navy ain Part of the SONAR gear оп у. 5 


. The 
8 рен £ 
ated of amination analyzed in this example con 
were 
» 


Socjat, Venty-five i 5 hich 

t 3 e items (I = 25) whi 

Range i ed with the determination of "Вал? 
ubmarine 


ig Sa 
locate measure of the distance а 5 


rom the SONAR gear and is 00% 


За. 
t chotomously score 


Rog да ау: š 
depens th examples in this paper utilized di 
"pon this method of scoringe 
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among other kinds of information indicated by 
the TRR. The proficiency examination consist- 
ed of recorded signals of submarines operating 
under sea conditions. These signals were re- 
corded on phono-discs and used toactivate twelve 
TRR trainers which were operated by 104 sub- 
jects (S - 104) who were learning to become so- 
narmen. The task of the student was to evaluate 
the range for each of the 25 signals (items). For 
reasons given in (1) the responses were scored 
dichotomously.* A score of 1 was given to 
the response if it did not differ by a given amount 
from the true distance between the submarine 
and the SONAR gear. Otherwise the response 
was scored 0. The examination was adm inis- 
tered twice (A = 2) during the training period of 
the students. These administrations occurred 
during the 16th and 21st weeks of training and 
will be so designated. 
The linear model of a response to an item (i) 
in an administration (a) by one of the subjects(s) 


may be written as: 
y(ias) = p+ 10) +o (а) + c(s) + (ia) + (15) 
+ (аз) + €(ias) 
izl,...,29-L a-1,...,2-A; S-l,...,104-8. 


eters are: p the general effect, 2 (1) 
the effect of the ИВ item, a (a) the effect of the 
ath administration, o(s) the effect of the sth stu- 
dent and all two and three factor interactions de- 
fined by their parscripts. For instance Фііа) 15 
the effect of the interaction between the ith item 
and the ath administration. The variance of a 
response i5 g? and it is assumed that responses 
py the same subject within an administration are 
intra-correlated to the degree p(D үнс 
ferred to as the coefficient of internal consisten- 
Responses by à subject to the same item in 
cy. ntra-correlated to 


i administrations are ii 
ditare h is referred to as the coef- 


The param 


ree p(A) whic 
m of external consistency. In the develop- 
i analysis of variance of the y(ias) it 


men 2 assumed that all parameters involving 

m а агэсгірі аге random variables and that re- 

uot. he same subject to different items in 
e correlated to the 


degree p = PV. 
ова that the intra- 
items in 
than 

should be less 
i items in the same a | 
differen: [s intra-correlation of the same items 
i different administrations. Therefore, ac- 
cording to the logic of the problem, p shouldbe 


d responses, the analyses made here do 
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either p(A) or p(I). 

gei cem ко на of p lead to different forms 
of the analysis of variance of the y(ias). In gen- 
eral, the choice p- p(A) p(I) seems most app ro- 
priate for the evaluation of responses to items in 
different administrations. However, this nee d 
not necessarily be the case for all types of items 
and conditions of administration. Thus, theanal- 
ysis for a general value of р needs to be consid- 
ered. The responses, y(ias), have beenanalyzed 
іп (6) in the form оға 3-way classification апа1- 
ysis of variance. Тһе expected variance, Е (Var), 
of the E[ IAS], E[IS], E[AS], and I[ S] sources 
of variation, for a general value of p, are given 
below: 


Е (Var. [ IAS] )=0?[ 1- P(I)-p(A)« p]. К 

Е (Маг. | 161) =ог[ 1- p(D4A-1p(A)-A-i 0]. 

Е (Маг. | AS]) -e?[ 1- р(А)+Т-1 Р()-Т-Тр). 

Е (Уаг. | $] ) =ог[1+1-1 p(D+A-Ip(A)+A-1 T-ip]. 


The expected mean Squares given in (6) agree 
with those given above if P is set equal to P(A) p 

(D. In the event that ар other than P(A) p(I) is 

assumed, a different method than the one shown 
m ог in (6) must be used to estimate Р(А), р(1) 
апар. 

Тһе сһоісе P = (А), is Suitable for the anal- 
ysis of data arising from certain experimental 
conditions. R. O. Collier (3) develops this mod- 
el theoretically, ав well as many other analysis 
of variance models Which involve correlated ob- 
Servations. A numerical illustration is also giv- 
en in (3) for which the assumption p - p(A) is ap- 
propriate. However, the illustration is not con- 
cerned with the type of psychometric analysis 
used here. 

The sums and sums of Squares which are bag. 
ic to the analysis of variance of the res ponses 
are given in Table III. The litera] values A, в, 
etc., of Table III are defined as in TableIV of (6). 
The layout of the responses is similar to that 
used in the previous example. The response rec- 
tangle is again laid out for each administration, 
and the sums of squares of the individual respon- 
ses within the administrations, are calc ulated, 

Finally, in effect, the rectangles are superim- 
posed on each other and the respective values 
summed. Then the sums (3385), and sums of 
squares of the totaled responses (5839), item to- 
tals (485803), and score totals (115915), are ob- 
tained. The analysis of variance is presentedat 
f Table IV. 
evt to determine the 95% С.І. “Г pes ра) 
d р(Н) a variance ratio table is used to fin 3 
and p 72;. 975] = 1.31, and F[IL] = 
F[IU] - F[ 103, 2472;. Ц ino dn- 
72 103;. 975] = 1/1.36 = . 735. Using 

1/F[ рн Ше variance column ої Table 
a i = 


val for р(1) is: 
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(3) 5.87 - .7 5.87 - 1.31 


35 
SBT + 2.735) > РІ > Бим) 


-22 >р) >.12, 


where 24 = 1-1. The confidence interval does not 
include zero so the hypothesis that o(D = 0(ог 
р(Н) = 0) is rejected at Ше .05 level of s ignifi- 
сапсе. The point estimate of p(I) is found by sub- 
Stituting 1.00 for 1.31 on the right side of (3). 
Thus г(1) = .16. The index of internal consis- 
tency, p(H), has а 95% C.I. given by 


4) 1-.735/5.87 > рн) > | - 1. 31/5. 87 
087 >p(H) > 277 


with the value of r(H) = .83 when we replace 1.31 
by 1.00 in (4), 

To obtain а 95% C.I. for P(A), the coefficient 
of external Consistency, we determine 2i AU] 
= F[ 103, 103;. 975] = 1.48, F[AL] - 1/F[103,103; 
:975] = 1/1.48 = .676, and F[A] = 1.1145/.8941 
71.25. In this special case where A = 2, F[ AL] 


=1/F[ AU]. With these numbers the interval is 
calculated as 


(5) 1.25-.676 1.48 


1.25 - 
1.35 + 1(.67бу > P(A) > 1:25 + 1.48) 


30 > p(A) > -. 08 


P(A) = 0 at the .05 level of significance. Тһе 
point estimate of Р(А) is found by substituting 
1.00 for 1.48 on the right of (5). The quantity 
r(A) = .11 is quite small. The responses to the 
twenty-five items evidently produce scores which 


Scoring system used and another, Particularly 


» is the variance ascribed to 
the equipment which was used in the study. 


It is also possible to obtain an index of extern- 
al consistency from the analysis of variance table. 
This index was not described in (6) but 
is related to p(A) by the following form- 
ula: 
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TABLE Ш 


SUMS, SUMS OF SQUARES AND ANALYSIS OF VARIANCE CALCULATIONS 
FOR THE DATA TAKEN FROM REFERENCE (1) 


Sums and Sums of Squares 


Administration 
Sum of Responses 55 y(ias) 1651 1734 3385 
8. S. of Responses e у? (ias) 1651 1734 5839* 
8. S. of Item Totals x 5 y(ias)]* 111095 126406 485803* 
8. S. of Total Scores uz у(іаз))? 28467 31826 115915% 
81 


Ir 


ctively. 


These numbers correspond to the numerators of E, А, and С, respe 


A А 
nalysis of Variance Calculations 


чені Zz y(ias)]*/AS = 485803/(2)(104) = 2335. 5913 
А _ 2204. 8296 
= 2122 y(ias)]*/18 = [ (1651)? + (1734)°]/(25)009 = 2204. 82 
2318. 3000 


ш Al i2 y(ias)]?/1A = 115915/(25)(2) = 


D- в 1.3558 
EBL Z y(ias)] 2/8 = [117095 + 26406] /104 = 234 


Е- 
PELE y(as]*/A = 5839/2 = 2919. 5000 
и т200 
а і - 2411. 
asl? y(ias)] 2/1 = [28467 + 31826] /25 
2203. 5048 


G- = 
[zzz y(ias)]^/1AS = (3386)?/(25)(2)0104) 


T= 
pee y?(ias) = 1651 + 1734 = 3385. 0000 
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TABLE IV 


THE DATA TAKE 


Analysis of Variance of the y(ias) 


UMMARY STATISTICS BY 
N FROM REFERENCE (1) 


(Vol. 25 


WEEKS OF TRAINING FOR 


Source of Degrees of 
Variation Freedom Sum of Squares Variance 
HÍ IA]; (ia) = I-i А-1 - 24 D-A-B+G = 4.4397 „1850 
E[ IAS] ІСІ А-18-1 = 2475 T-D-E-F. і 
A+B+C-G 367. 6403 . 1487 
Hf 1]; u(i) = гі = 24 A-G - 132.0865 5. 5036 29. 00** 
E[ IS] 1-1 571 = 2472 E-A-C+G 469.1135 - 1898 
НІ А| а (а) = 0 А-1 = 1 в-с = 1.3248 1.3248 1. 
Е[ As] А-1 8-1 = 103 Е-В-С+С 92. 0952 o _ 
i c Deck mer ИЕ а= 0 1 = 2203. 5048 22. 
E[ 5] S-i 7 103 с-с 114.7952 1 uM ELE бе bu 1 
Total dn ы ee tnim z: - 5200 T - 3385. a вино a NN NN 
p п - - rejected at least at the ,01 level of Significance, 
П. Summary Statistics by Weeks of NR c uuo оо TT 
SS c ш 16th Week 21st Week Composite 
Items 25 25 
Subjects 104 104 да 
Mean Score 15.88 16.67 16.27 
ги) :14 :19 116 
r(H) - 80 . 86 ‚82 
"s ... РЧА š 11 
В ТТ ЕА .20 
5.Е.М. 2.10 2.02 6. 69 
S. D. (Scores) 4. 68 5.32 7:46 
Mean (Item Diff.) - 64 . 67 ° 65 
S. D. (Item Diff.) .18 > 15 


„16 
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(8) Ap(A) 


1+А-1 p(A) 


de relationship of p(A) to p(B) corresponds to 
r(B) мо ашр of р(1) to р(Н). Тһе quantity 
evaluati ich estimates p(B), would be useful in 
fume СОРЫЛЫП өтіп the administra- 
Cate that each subject. А large r(B) would indi- 
istratio, compounding the scores over the admin- 
eren ns is effective for detecting individualdif- 
Ces between the subjects. 


Т 
О C.I. for р(В) is given by the wide 


e(B) = 


(7) 1- 
)1-.676/1.25 > p(B) >1 - 1. 48/1. 25 
.46 > p(B) > -.18 


Тһ з 
tight ake estimate of r(B) is obtainedfrom the 
is Че of (7) by replacing 1. 48 by 1. 00. In 
Ple estim r(B) = .20 which agrees with the sam- 
= 22/1 11 torm of (6), т(В) = 2( 11)/[141(12] 
and the h 7.20. The estimate of r(B) is low 
e .05 Coe that p(B) = 0 is accepted at 
ite Siege of significance. Thus Ше compos- 
ing indi 5 are of very limited value for detect- 
one differences. 
hypothesis 3318 of variance table shows that the 
one. 516815 ОГ no administration effects with а 
(F - не alternative hypothesis was accepted 
Students ). The estimated average gain of the 
Only або Over the five week training period was 
fact input 1 test point, 16.67 - 15.88=.79. This 
‘ng the Cates thaton the average, learning dur- 
le Iv ae was meager for the students. Tab- 
administ Indicates that there was little item- 
the itep ation interaction, (Е = 1.24), and that 
29. 00118 differed considerably in difficulty (F = 
Week was The average difficulty in the 16th 
q ав 16 15. 88/25 = . 64 and in the 21st week 
ditto 16. 67/25 = „67. Тһе composite average 


Teveal th was 16.27/25 = .65. These numbers 
tive) » Оп the average, the items were rel- 


ощ ү for the students, since the average 

france > Вгеаіег than . 50. Tightening the 
hee in scoring the responses WOU 

8. The standard deviation of the com- 


iculties was V5. 5036/208 = .16. Рог 


8 ar 
tan ate administrations the item difficulty 


үле s teVlations меге .18 and.19. 
қт Standard error of measurement 
Не С айп, for a total score obtained on а 
oè Sxpecte nistration may be found by noting that 
ear ува the variance of E[ IS] is 
of рду, + А-1 0(А)]. Since the estimated 
e : 11, А-1 = 1, and the variance 
Малы lla inm IV is .1898, the quantity 
mu d erro, is computed. Toobtain 
the eua of imeasuremeni (в. E. M.), 1110 
Ware г Y the number of items, I = 25, and 
Cot of the resulting number is taken 
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Thus, У25(.1710) = 2.07. Тһе S.E.M.’s as esti- 
mated from data from each of Ше separate admin- 
istrations is shown in Part II of Table IV. These 
composite scores, thatis, thetotalscore obtained 
from adding the separate totals obtained by each 
subject on the two administrations also has a 
standard error of measurement. To find this 
number, the variance of E[ AS] is multiplied by 
IA = (25) (2), and the square root is taken. There- 
fore V (25) (2) (. 8941) = 6.69. This number is 
large relative to the standard deviationof the com- 
posite scores, Y (25 (2) (1. 1145) = 7.46, and indi- 
cates at once that the estimate of р(А) should be 
small. The standard deviation of scores between 
administrations is almost as large as the stand- 
ard deviation of the composite scores. The esti- 
mate of the standard deviation of the total score 
of a single administration is found by dividing the 
variance of E[ S] by 1 + A-1 r(A) = 1.11, multiply- 
ing this quotient by I- 25 and taking EEEo 
root. Thus, the S.D. = (25) (1. 1145)/1.11=5.01. 
The S.D.’s which were estimated separately 
from data of each of the administrations are 
shown at the bottom of Table IV. 

Estimates of р(1), e(H), р(А), and p(B) may 
be obtained by using another F[ I] апа Е[ A] cal- 
om the variance column of Table IV. 


culated fri 
When F[I] = .8941/.1487 = 6.01, г(1) =.17, г(Н) 
= .83 and these numbers are very like the г(1) - 


16 and r(H) = .82, which were previously ob- 
tained. Also F[A] can be evaluated as .1898/ 
= 1.28, and this gives r(A) = .12 and r(B) 


.1487 

= .22, which are close to the other r(A) =. 11 and 

r(B) = .20. ) 
presented, it appears 


In lieu of the evidence 
that an examination consisting of the 25 range 
items which is administered to SONAR stud ents 
during their 16th and 21st weeks of training, per- 
mits the detection of individual differences to a 
moderate degree; r(H) = .82, ona single admin- 
istration. The coefficient of internal consis- 
tency, г() = .16, although numerically small, 
actually is quite large in comparison to other ex- 
amination data which have been analyzed by the 
method. The consistency of responses to the 

ог equivalently the consistency of 
etween the two administrations is, 
г, very 10%, r(A) = .11, and this value 
Е 11у significant at Ше .05 
The two sets of responses 
nt to a favorable degree 
. They are unfavorably externally con- 
t. This condition pes er eme im» 
m etected to a moderate 
difference can Dé анов because of the 


i the nature of these 


not account 


further rese 
mine possible causes 
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ysis for another sample under the same condi- 
tions has not been possible as yet. When this 
can be done, perhaps the scores for the 18th 
week of training can be collected and the effects 
of the TRR’s used in the study can be controlled. 
Totaling the scores for each subject over the 
two administrations does not facilitate the detec- 
tion of individual differences since the scores 
made on each administration, being almost ex- 
ternally inconsistent, will total toa set which 
have a variance not much greater than the stand- 
ard error of measurement which would be used 
to detect individual differences in the composite 
scores. This example is unique in thatit shows 
that it is possible to obtain high internal consis- 
tency and low external consistency of responses 
to items of homogeneous material from subjects 
who take the same examination at two different 
times under similar conditions. Admittedly, the 
administrations were quite far apart in respect 
to the usual test-retest situtation, but neverthe- 
less, the results were quite unusual. 


Summary 


The arithmetic operations involved in estimat- 
ing coefficients of external and internal consis- 
tency of the responses to items from an examin- 
ation have been illustrated. Two kinds of anal- 
yses were involved. One concerned the evalua- 
tion of the internal consistency of the responses 
in a single experimental situation wherein three 
methods (groups), were being compared. This 
corresponded to an analysis given in (5), and 
used data taken from (4). The other anal ysis 
concerned the evaluation of both internal and ex- 
ternal consistency coefficients and indices from 
responses given by students to the items on an 
examination which was administered on two dif- 
ferent occasions. Reference (6) provided the ba- 
sis for the analysis and (1) supplied the data. 

The analyses of variance which were used in 
these two examples provide an efficient and con- 
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venient means of determining the usual statistics 
necessary to make a psychometric analysis. The 
coefficients and indices of external and internal 
consistency are estimated easily by point and by 
interval. Also the standard deviations of the 
Scores, the standard errors of measurementand 
certain item statistics are readily calculated. 
Additionally, tests of hypotheses regarding the 


parameters of the response model are easily 
made. 
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THE RELATIVE ACHIEVEMENT OF THE OB- 
JECTIVES OF ELEMENTARY SCHOOL 
SCIENCE IN MINNESOTA SCHOOLS 


JANE JOHNSTON 
Moorhead State Teachers College 
Moorhead, Minnesota 


E. WHAT extent are the objectives of elemen- 
кс азый Science Беше achieved in Minnesota 
vati 0152 What pupil, teacher, and teaching -sit- 
ree factors contribute to the achievement of 
Objectives? What are the implications for 
е education of elementary school teachers? 
а п ра were considered in a recent an- 
i муе сіепсе іп 
Minnesota, 1% y of elementary school scie 
ubi various parts of the survey the sampling 
ing Snail the school system (used only in secur- 
or рте | data), the fifth-grade teacher, 
res ifth-grade class (a cluster sample). 
wi a preliminary questionnaire dealing 
ties рац | school science teaching fac ili- 
ents of Procedures was sent to 478 superintend - 
in Min Public graded elementary school systems 
nesota, 1952. 
of 87 бора stratified random sampling 
ав ве -grade teachers from (һе same schools 
Cured in the following manner: 


cords їз were divided into four strata ac - 
menta, 9 the number of teachers in their е1е- 
twent, у 5Сһо015--оуег fifty teachers (Group 1), 
ele ies through fifty teachers (Group II), 
throu fhrough 20 teachers (Group III), and one 
ГЕ ten teachers (Group IV). 
Sleven Mies 1, the smallest group, contained 
Schools Chools. It was decided to include two 
Same (18.2 percent) from this group, and the 
Sther е семаве of schools from each of the 
1 Tee groups. 
hen Men names of the school systems were 
mi alphabetically for each stratum, and 
fom iue ed in that order. Appropriate ran- 
isting t ber tables were used to select from this 
Group |"? Schools from Group I, seven from 


Тоқ тани from Group Ш, and sixty-six 


t 


twe | 
teaching nty-two item questionnaire dealing with 
ариев taiberience, colleges attended and 
кце for еј еп, materials and facilities ауа11- 
en ods ene school science teaching, 
in - апа ed in teaching elementary school sci- 


tity, © Classro 


foot, S 
notes wi +i 
95 will be found at end of 27151924 


idis No 


€ and emphasis placed on science .. 
че Om was sent to the eighty-seVen саң 
E €achers participating in the Survey. | 


The substantial agreement between answers 
to similar questions on the superintendents' and 
teachers’ questionnaires, and the fact that com- 
plete questionnaire returns were secured from 
over 98 percent of the superintendents and 95 
percent of the teachers, provided checks on the 
reliability and completeness of the information 
provided. 

A log of science activities in their class- 
rooms was kept by a sub-sample of thirty of the 
eighty-seven participating teachers. The teach- 
ers in this sample were selected by random sam- 
pling methods (random numbers) and were as- 
signed at random to three different time periods 
of ten days each. Information from these logs 
provided a check on information in the two ques- 
tionnaires, and furnished additional information 
on the science activities and teaching methods 
that were being used. 

According to questionnaire and log replies 
(1954), emphasis on science in elementary class- 
rooms was less than that given to social studies 
or reading, and more than that given to music or 
art; the typical science class was thirty minutes 
long, and the average time spent on Science per 
week was under two hours. About sixty percent 
of the schools had some purchased science equip- 
ment. Although most of the teachers reported 
that equal emphasis was given to biological and 
physical science, their logs indicated thatbiolog- 
ical science topics were considered in a ratio of 
3:1 to physical science topics. Textreadingand 
discussion was the *tmost-used'' science teach- 
ing method, while field trips andlaboratory work 
were the ‘‘least-used. "" The typical teacher had 
taken college courses in biology and health, had 
not taken courses in physical science or the 
teaching of science, and did not have a college 
degree. 

Information on fifth-grade pupils taught by the 
eighty-seven participating teachers was secured 
by means of a science test (administered in De- 
cember 1953, and again in May 1954), an intelli- 
gence test, and a science reading test. One hun- 
dred percent returns were obtained. 


___-The-103=itent science test, constructed by the 


я waiter quas designed to test knowledge of sci- 


ence facte relationships, and generalizations. 
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Subject matter included in the test was de ter- 
mined by (a) examining the Science section of 
the Minnesota Curriculum Bulletin Number 5 
A Guide for Teaching Science and Conservation , 
and including some questions on each phas e of 
Science mentioned; (b) including additional bio- 
logical science questions, because that Section 
of the Curriculum Bulletin is limited; (c) omit- 
ting questions on health, conservation, and safe- 
ty because these topics have traditionally been 
included in social studies units, and it was de- 
Sired to find out how much science the pupils 
were learning; and (d) including some questions 
from each of the important areas of Science—as 
determined from examination of children's text- 
books, curriculum bulletins, textbooks on Sci- 
ence teaching, and research recommendations— 
Such areas as plants and animals, the various 
forms of energy, transportation and communica- 
tion, simple chemistry, astronomy, earth sci- 
ence, simple machines, and size and time rela- 
tionships. 

Before its administration, the test was sub- 
mitted for criticism to six expert teachers of sci- 
епсе, and a trial form of the test was adminis- 
tered to two fifth-grade and two sixth-grade clas- 
Ses, in order to detect confusing directions or 
questions, and to estimate the time needed to ad- 
minister the test. Teachers who administered 
the first tests in December did not know that the 
same test was to be repeated the following May, 
and all tests were returned to the writer after 
the first administration to the eighty-seven fifth- 
grade classes. Test results on both the pretest 
and retest were secured from all eighty-sevenof 
the participating fifth grades. The reliability of 
the science test was calculated by the split-test 
method, obtaining the maximum likelihood esti- 
mate." Тһе reliability of the pretest was found 
to be . 91, and of the retest, .94. 

Statistical techniques used in analyzing test 
and questionnaire results included the following: 


1. The “t” test was used to determine the 
significance of the differences between m eans 
on the science pretest and retest. 4 

2. Cluster sample statistical treatment was 
used in determining the sample estimate of the 
population mean and variance of the mean on the 
science tests. In the testing program, the fifth- 
grade class to be tested was selected by random 
sampling methods. Thus each fifth-grade class 
in the population stratum had an equal chance of 
being selected. This fifth-grade class was, how- 

r, acluster sample; each individual pupil in 
Ed whole population stratum of fifth-grade pupils 
Ше м did not have an equal chance of be- 
"€ | lected. In calculating Ше estimated mean 
Ing ве iance for the population from this sample, 

ven те cluster sample statistical analysis 
thereon à in which each mean was weighted by 
was , 
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the size of that particular fifth-grade class. The 
calculation formula for the population mean was: 


TE ul. 

> піХі 
= 1=1 ZZXi 
Хс = = е. 


m N 


where njXj is the number of individuals in the ith 
cluster multiplied by the mean of the ith cluster, 
and the estimated population mean is the sum of 
all of these quantities calculated for each of the 

eighty-seven groups and divided by the total num- 
ber of individuals in the sample. 

Results of the above calculations sho wed the 
Sample estimate of the population mean to be 
99.54 for the science pretest and 64. 67 for the 
retest, with a mean gain of 5.13 points. When 
the “t” test of significance was applied to this 
ваш, it was found to be significant at the . 011ev- 
el. 

3. The analysis of variance statistical treat- 
ment was used to compare science test scores 
received by pupils in three different I. Q. groups. 
The following results were found: (a) Of thetotal 
group of 1850 pupils, 147 were found to have 
1.0.5 of 121 plus; 1153 to have I, Q.'s of 95-115; 
and 207 to have І. Q.'s of below 90. Science test 
sub-score means on Physical science and gener- 
alization questions were found to be significantly 
different (. 01 level) for the three I. ©. groups. 
(b) Mean Bains of the three 1. Q. groups between 
the pretest and retest were not found to be signif- 
icantly different. 

4. The analysis of variance and analysis of 
Variance and covariance statistical techniques 
Were used to relate mean gains of fifth-grade 
Classes between the science pretest and rete st 
to each of the following teacher or teaching-situ- 
ation factors: 
ber of science areas in which teacher took col- 
lege courses; teachers’ years of teaching exper- 
ience; whether or not the teacher took a college 


room other th: 
placed on sci 
of the followi 


an textbooks; time and я 
епсе; and Ше relative use of еас 
ng in Science teaching: 


Visual aids 
Group planning of Science projects 


Group performing of science projects 
Research reading 
Teacher-demonstration and explanation 
Individual laboratory work 


A statistically Significant relationship between 
the teacher-factor being Considered and class 


gains on the science tests was found in one 
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case. Тһе relationship between class gains and 
the teacher's number of years of teaching exper- 
ience was found to be significant at the .05 level 
(analysis of variance and covariance). Informa- 
tion on this analysis will be found in Table L | 
The fact remains that most of the pupils did 
gain significantly on test scores іп the five-month 
interval between the tests, but some fifth-grade 
groups gained more than others, some did not 
gain significantly, and some lost rather than 
gained. These differences in amounts of gain 
are not therefore due to the lapse of time and in- 
creasing maturity of the pupils alone; neither do 
they appear to be significantly related to pupil 
1.9. ог to any of the teacher ог teaching-situa- 
ation factors which were investigated, with the 
exception of the teacher’s years of teaching ex- 
perience. 

Further analysis could be made to determine 
whether any combination of tea cher-factors 
showed a significant relationship to pupil gains, 
or whether reading test results showed a signif- 
icant relationship to science test results. These 
analyses are not reported here. 

The results of the Statistical analysis of ques- 
tionnaire and test data may indicate a true lack 
of relationship between the teacher-factors 
checked and the Pupils’ science achievement, or 
they may reflect the fact that the general level 
of teacher preparation in Science was limited; 
therefore, the differences between teachers and 
teaching practices were not marked enough to ef- 
fect significant differences in class achievement. 

The study reveals some information which 
has implications for the preparation of elemen- 
tary school teachers. 

In the group of 1850 fifth-grade pupils on 
whom complete test data were available, 147 
were found to have I. Q.'s of over 120. It can 
thus be estimated that approximately 1732 Min- 
nesota fifth-grade pupils (1954), exclusive of 
those in Minneapolis, St. Paul, and Duluth, had 
1.0.8 of 121 plus. With the current needfor ca 
able adult scientists, and the knowledge that they 
are generally from this high I. Q. group, the in- 

dications from this study that many ele mentary 
school teachers are failing to (a) differentiate 
classroom work sufficiently so that the talented 
achieve in proportion to their abilities, and (b) 
sample adequately the various science a reas 
and activities so that vocational and avocational 
interests are aroused early, have important іш- 
сватання, Certainly Ше tendency to emphasize 
btologieal science at the expense of physical 54 
ence, the limited physical Science background o 
typical teacher in this survey, the predomin- 
Ше typ -discussion method in 
ant use of the textbook-discu enata 
teaching science, and the almost complete a 
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Sence of individual laboratory work and true ex- 
periments in the classrooms, indicate that the 
potential scientists are not being provided for. 
The objectives of elementary school science, 
moreover, do not apply only to those who intend 
to pursue scientific careers; they apply to all 
children. Itis unlikely that Minnesota children 
in general are profiting any more from the pres- 
ent science program than are the high-ability 
children. Research is needed to determine the 
best ways of providing prospective and in-ser- 
vice teachers with the ‘know-how’? and emotion- 
al push necessary to enable them to provide a 
dynamic science program for each one of their 
pupils, potential nuclear Physicist and bird- 
watcher alike. Р 
This study made possible a detailed descrip- 
tion of the teachers, science teaching practices, 
and science teaching facilities in Minnesota fifth- 
grade classrooms in 1954. It made available а 
record of the I. Q.'s and science test scores of а 
representative sampling of Minnesota fifth-grade 
classes, from which it was possible to general- 
ize for the state as a whole. It provided informa- 
tion on the extent to which the objectives of ele- 
mentary school Science, as measured by gains 
in a science achievement test, are being achieved 
in the elementary schools of Minnesota, the lim- 
itations in the present program, and suggestions 
for further research on the best methods of pre- 
paring teachers to further the achievement of the 


objectives of elementary school Science with 
their pupils. 
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CONTROLLED EXPERIMENTATION 
IN THE CLASSROOM* 


JULIAN C. STANLEY 
University of Wisconsin 


МА Аалы. is that much more controlled ex- 
ë созден tion under classroom conditions should 
буе s ЕхрегипешаНоп” as used here is not 
portant аы uncontrolled experientation, іт- 
edly is EM such experiental analysis undoubt- 
they are , жойы. T ені status studies unless 
trolled design, ed in an experimentally соп- 
on two general types of controlled ех- 
е “meth ius 0 classrooms. Опе of these is 
of doing s ods” study in which two or more ways 
fashion omething are compared in an unbiased 
research The other is so-called “(fundamental 
Principles Whose intent is to derive gene ral 
ation in applicable beyond the immediate situ- 

Which they are found. We needfar more 


of 

both types of research. 
The S eech Stud 

Consi 
methodo the following example of the many 
virt ly Ogical decisions teachers must make 
of helping vers дау. Recently I had the pleasure 
ал expe € Several high-school teachers set up 


observing want to determine the effectiveness of 
Natura В Seventh graders unobtrusively in the 
them in Context of the classroom and then telling 
they neste E Specifically which speech faults 
Logical} - to correct, and how to correctthem. 
Speech n4 and intuitively, it was apparent to the 
Suite er не that this procedure should be 
Studen очи, far better than just instructing 
truction the speech class or having no formal 
minqeq з. 2t all. They were scientifically 
ject thei, pever, and therefore decided to sub- 
bs ei , Dunch to empirical test. The des ign 
ka: aspects 19У should serve to illuminate sev- 
sp They mi of careful experimentation. 
арбесһ с ho have taken the students in each 
of Уйде 1- the beginning of the semester 
а Om woul em randomly into two groups, one 
рее the ди be “followed” in other classes 
оу ections mester and notified of speech іт - 
im ед. » Tees other group would not be ‘‘fol- 
ere Toving ge extra attention was effective in 
теа 2 5 ОША [eee behavior, then the ‘followed’ 
gre er y th € the better speakers and oral 
ly 08 in int е end of the semester. Having both 
Or у 1 !htermixed order speak and read oral- 


R 68 who do not know to which group а 


evs 
tig sed 5 
з Novemb 

er |, 1954 


ersion of a paper read to the Educational Research Section of the 


given individual belongs is a means of securing 
unbiased ratings that can then be separated for 
the two groups and compared. If the average rat- 
ing of the ‘‘followed’’ group is significantly larg- 
er than the average rating of Ше “по followed’? 
group, then we would conclude that the extra at- 
tention is having some positive influence upon 
speaking. Of course, the influence still might 
not be great enough to warrant the expenditure of 
time and money, but at least “following” would 
be shown to be having some effect. 

In this sort of experiment it is easy to test 
additional hypotheses without using any more stu- 
dents than are necessary for the simple compar- 
ison of the ‘‘followed’’ and **not-followed'' group. 
One might, for instance, hypothesize that ‘‘fol- 
lowing’’ would work better for girls thanfor boys. 
By dividing the students first by sexand then ran- 
domly by followed vs. non-followed group (see 
Table I), we can answer two new questions: (1) 
Do boys differ from girls on the ratings? (2) Are 
there differences between the sexes with respect 
to the value of ‘‘following’’? 

Going still further, we might include in the 
experiment both those persons who are taking 
speech and those taking English, dividing all the 
speech students into two sex groups and subdivid- 
ing each of these into the “followed” vs. the 
«‘non-followed. " Similarly, we would separate 
the English students into boys and girls, then di- 
viding the boys into “followed” vs. “поп-і01- 
lowed” and the girls likewise. See Table II. 

This arrangement results ineight groups: 
boys taking speech who are followed, boys taking 
speech who are not followed, girls taking speech 
who are followed, girls taking speech who are 
not followed, boys taking English who are fol- 
lowed, boys taking English who are not followed, 
girls taking English who are followed, and girls 
taking English who are not followed. It enables 
us to answer seven different questions, contrast- 
ed with only one for the two-group design and 
three for the four sex-method groups, and yet 
requires no more students than the two- group 
setup. The seven questions that can be answered 
are; Do boys differ from girls with respect to 
speaking or oral reading ability? Do those per- 
sons taking speech differ from those taking Eng- 
lish? Does the ‘‘followed’’ group differ from 
the *non-followed" group? Are there interac- 
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i Е sex, subject, and method, sex and sub- 
jest, Sex and method, or subjectand method? 1* 
The four- and eight-group arrangem ents 

shown in Tables I and II are both “factorial de- 
signs." We have two levels of eachfactor—sex, 
subject, and method— combined in all possible 
ways with each other to yield eight different sex- 
subject-method groups in Table П. The huge 
advantages of factorial designs are that they al- 
low several variables to be manipulated si mul- 


interactions possible, Frequently heard objec- 
tions to the artificiality of Controlled experimen- 
tation involving the manipulation of a Single var- 
iable in a sort of vacuum, with other factor S 


were considering only a single variable such as 
“followed” уз. “поп-оПомей.” Аз yet, this 


experiment actually conducted, Results were 
allnegative, Тһе boys and 
read equally well, the speech classes did not 
do appreciably better than the Eng 
the “ЧоПоуед” Students were nob 


money. 
It is essential to remember the Conditions 
under which we experimented, however, Hay- 
ing used only seventh graders in acertain rath- 
er atypical type of school, we cannot generalize 
our conclusions to other grades or other schools, 
The method of ‘‘following”’ we used is the only 
one for which we have information; another 
method might be effective. Our findings are lim- 
ited by the nature of the speech and oral reading 
ratings secured, and by the Competencies and 
idiosyncrasies of the 10 particular rate rs in- 
volved. Furthermore, the rating Situation it- 
11 may be too formal and unlifelike to elicit 
= га! speech behavior from Ше students. Fin- 
e we gathered our data at the end of the first 
45. and consequently cannot make state- 
а. applicable to Ше whole year. Never the- 
E there is certainly no positive evidence in 
г es n controlled study that being fol- 
ons is worthwhile. Henceforth, the burdenof 


1 footnotes will be found at end of article, 
AL 
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proof is upon proponents of “following” rather 
than upon its opponents. They may wantto launch 
new experimentation to test further hypotheses, 
Such as the following: another well defined meth- 
od of following is effective; following works bet- 
ter in other grades than it does in the seventh; 
following is more effective in other schools than 
here; other measures of speaking and oral read- 
ing ability reveal the effectiveness of following. 
Where possible, we try to design methods ex- 
periments so as to answer questions more gener- 
al than the purely local problem under considera- 
tion. Relating the Study to a conceptual sche me 
or theory from which results can be deduced in 
advance enables us to test important aspects of 
the theory while we are getting our specific infor- 
mation. How well this can be done depends large- 
ly upon how advanced conceptually the field in 
which we are Working is. If speech theorists 
have devised definite frameworks to unify their 
field, then we can test deductions based upon 
these. For example, if one theory emphasizes 
changing the individual's Self-concept in a беле 
tain way, we сап use a method of **follo wing 
that is congruent with it. Or, if another theorist 


ences in a speaking Situation, we can try to ac- 
complish that. Because of the numerous ways to 
assist or tutor a student, we must select the 

ones for trial on the best Possible logical andem- 


Pirical grounds, rather than just picking at ran- 
dom. 


The Opinion-Change Study 
— ange Study 


not they should 
Its results wer 


y conducted by Herbert Klau в 
yself2 may illustrate this semi- 
е of experiment. 

We were interested in 


145 b 


Then for my experiment] chose 
low scorers “isolationists’’) and high scorers 


м 
Sen, 1957) STANLEY 


TABLE I 


A FOUR-GROUP (SEX-METHOD) FACTORIAL DESIGN* 


Method 


*There are n students in each of the four groups, or 4n stu- 
dents in the entire experiment. Half of the 2n boys are as- 
signed randomly to the ‘‘not followed’’ group and the о the т 
half to the “followed’’ group. Similarly, half of the 2n girls 
are assigned randomly to the “по! followed’’ group. 


TABLE H 


АК EIGHT-GROUP (SEX-SUBJECT-METHOD) FACTORIAL DESIGN* 


A GuxN CM БЕН 
Boys ETE 


—€— Wu c Prose 


"Each s (speech-not followed, speec h- 

boy i i one of four group ech 5 EDS 

followed, ўз аззделай гааг p^ English-followed). Likewise, each girl is as- 
Signed ràndoral tà = f the four groups. Preferably, each of the eight groups will 
Contain the sam б of students; іп the speech study there were six students in 


e 
ach of the eight groups. 
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-fourth play a role congruent with their ini- 
tial pore one-fourth to play no role but to 
serve as first-row observers, and one-fourth to 
go to the library before the experiment began 
and work on unrelated material. Thus there 
were four ‘‘role’’ groups: different role, same 
role, observer, and outside control. Eachof the 
four role groups contained an equal num ber of 
men and women, and each had halfofits persons 
whose initial opinions were ‘‘isolationist’’ and 
half who were initially ‘‘internationalist. ” In all, 
there were 16 role-sex-initial opinion gro ups, 
as shown in Table III. Seven hypotheses сап be 
tested with this design, using change-of-opinion 
scores based upon differences between the first 
opinionnaire and a similar opinionnaire adminis- 
tered the day after the experiment: 


Are the differences among the four roles sig- 
nificant? Do the changes of men differ from 
those of women? Does it make any difference 
with respect to opinion change whether the per- 
son was originally ‘‘isolationist’? or *interna- 
tionalist"? Are any of the interactions am ong 
Sex, initial opinion, and role significant? 

Klausmeier's design was identical with mine, 
except that where I used а “sex” classification 
he used “аре”: 31 or less vs. 32 or more. Un- 
der our conditions, role playing had no effect up- 
оп opinion. We had hypothesized that persons 
playing a role in line with their initial opinions 
Should change little, while persons playing an 
opposite role should shift in the direction of that 
point of view, but this did not happen. Nor did 
the persons playing a compatible role c hange 
significantly less than the persons who left the 
room without even observing the role playing. 
Our only positive finding was a Slight tendenc y 
for the women in my study to get more world- 
minded and the men less world-minded; this in- 
teraction of sex with initial opinions may be at- 
tributable merely to chance. 


Implications 


Since both of the studies I have outlined yield- 
ed essentially negative findings, you may wonder 
whether these experiments were worth perform- 
i Obviously, it is valuable to know that fol- 
ренти students to observe and record their 

ech errors for their information is not effec- 

ive It is probably of even greater importance 
eles that confident claims for the opinion- 
_ dif ing influence of role playing do not hold 
ү Я pentane’ experiment.? Both ехрегі- 
са highlight the fact that hypotheses must be 
bee pea irically as well as logically. Our best 
wies Ане may be worthless ог downright 
inei = Expert opinions, pooled judgments, 
ШЕ мді intuitions, and shrewd hunches are fre- 
bri ily misleading: Ultimately, they must be 
quen 
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tested by the careful gathering of evaluative data 
if education is to advance on the basis of sound 
principles. | 

We badly need educational experimentation of 
the controlled variety. Too muchof our research 
effort has been directed toward questionnaires, 
Statistical compilations, and dead-end corr ela- 
tional studies. We have shied away from design- 
ing and executing studies involving the manipula- 
tion of pertinent variables. Our colleagues in ag- 
riculture and the behaviorial sciences such as 
Psychology have forged far ahead of us experi- 
mentally. Yet we cannot rely upon psychologists, 
Sociologists, and anthropologists to do our exper- 
imentation. They provide much relevant theory 
and many enticing hypotheses for us, butwe must 


hoe our own garden; they cannot be expected to 
do this. 


Obstacles to Controlled Experimentation 
ronnie Experimentation 


In my opinion, one of the major reasons why 
experimentation in education has languished is 
that our graduate schools have been confused by 
a false practitioner versus research distinction. 
This has lead in most schools of education to the 
training of few, if any, persons in educational 
experimentation as such. Whereas almost по 
psychology major can earn а Ph.D. degree ina 
reputable university without prolonged exposure 
to experimental Psychology, Statistics, and meas- 
“rement, we let the great majority of our doctor- 
а] candidates get through their dissertations with 
hardly the basic rudiments of training for experi- 
mentation. And training is essential. While it 
is true that many persons who receive suchtrain- 
ing will actually engage in little experimentation; 
untrained individuals are virtually certain to do 
none or to do it ineptly. 

Another reason for the paucity of educational 
experimentation is that university professors in 
Schools of education typically do very little them- 
Selves. Until they provide the training for exper- 
imentation and set appropriate examples for their 
Students, improvement is unlikely. 

Few public school administrators and even 
fewer parents realize the dire 
tinual experimentation. 
tation with vivisection. 
the use of control 


wo the method. Perhaps the 
S of Salk's polio vaccine 


will be a salutary antidote to this attitude, though 


TABLE III 


A FACTORIALLY DESIGNED CHANGE-OF-OPINION EXPERIMENT INVOLVING 16 GROUPS* 


Initial 
Opinions 


Internationalist 
Isolationist 


Internationalist 


Outside 
Control 


First-Row 
Observer 


Congruent with Opposite to 
Initial Opinions Initial Opinions 


Men 


Isolationist 


*There were two persons in each of the 16 groups, a total of 32 in the experiment, not counting the 30 
raters. Each man was assigned randomly to one of the four role groups; women were assigned 
similarly. 


(1961 "одер 


AWINVLS 
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Two essential ingredients of controlled ех - 
perimentation are difficult to incorporate into 
our thinking. One is the imperative needfor de- 
signing experiments ‘‘from scratch." Experi- 
ments do not just grow.” They must be 
planned in advance down to the finest detail. The 
final analysis of data must be anticipated and 
worked through abstractly or in a pilot study be- 
fore the experiment itself begins. This preplan- 
ning phase will usually require more time than 

the actual experiment. Once all aspects of the 
design have been thought through and refined as 
much as possible, the experiment must be run 
off exactly as planned, allowing only for unavoid- 
able disasters. We hear a great deal about 
“flexible experimentation, ” but once set in mo- 
tion a controlled experiment is completely rig- 
id and inflexible. Flexibility must be reserved 
for the preplanning and postplanning phases. 
The experimental findings almost invaria bly 
suggest new hypotheses that can be tested exper- 
imentally. 

The second difficult Concept to put over is the 
crucial need for randomization. The very no- 
tion of randomization is hard to grasp, since it 
implies chaos for the Single case and a high de- 
gree of order for the group. Suppose that you 
have 30 pupils in a class and that you wanta con- 
trol group of 15 and an experimental group the 
same size. How shall you divide the class into 
halves in order not to give an undeserved lead 
to one group or the other? If there were five 
seats to a row, you might consider taking all stu- 
dents in the first three rows for one group and 
all in the last three rows for the other group. 
Would this procedure yield two groups of equal 
ability for, say, an arithmetic experiment? Not 
in most classes, for seating is hardly likely to 
be random. If mostly girls sit near the front 
of the room and mostly boys near the rear, 
and if one sex surpasses the other in arithmetic 
Skill, results of the experiment will be biased 
at the very beginning. 

We might put all 30 names into a hat, each 

a separate slip, shuffle them thoroughly, and 
then m out 15. Or, somewhatless defensibly, 
we might alphabetize the 30 names and put the 

odd-numbered persons (1,3,5,..,29) in one 
group and the even-numbered persons (2, 4, 6, 
...,90) in the other. Тһе best method is to 
number the children from 1 through 30 (or from 
0 through 29) and draw 15 numbers within this 
ange from a table of random numbers. In all 
йына instances— shuffling slips, alphabeti zing, 
ndom numbers—it is essential to decide 
ane a oni ribe ME dau] xm aad 
m анас erimental. We cannot wait until 
which the ар group our prize pupil happens 
we note d дна call this the experimental group. 
К must be without bias if they are to 
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yield unambiguous conclusions. 

I cannot stress too heavily the need for get- 
ting fresh data specifically designed to an s wer 
the questions you pose. Too often a researcher, 
particularly a thesis-driven graduate student, is 
tempted to exhume some moribund material he 
finds stored away in a convenient maus oleum 
and perform a statistical au topsy onit. This 
“seeing what the data died of” is good clinical 
medicine but rarely worthwhile research. The 
persons who originally collected the data did not 
have the present problem in mind, so it would be 
quite unusual for the data to bear directly on the 
current hypotheses. About all you can get out of 
this post-mortem analysis is a crazy patchwork 
quilt of guarded conclusions and tortuous qualify- 
ing statements. The customary upshot is to say 
that “more research is needed.” Of course it 
is, but not research of this foredoomed variety. 

Almost as culpable is the person who gathers 
mountains of data as he goes along, without any 
particular experimental design, in the hope that 
eventually it will serve to test some hypotheses 
he gets around to formulating. In many instances 
this is a collossal waste of time and ene rgy, 
harking back to the exploratory days of the late 
nineteenth century and the biometrical approach 
of Karl Pearson. Since 1925, and particularly 
since 1935, when R. A. Fisher’s The De- 
sign of Experiments appeared, we have known тн 
about the inefficiency of this **sawed-oft shotgun 
approach. No longer do we need huge numbers 
of experimental subjects in order to reach valid 
conclusions. Small-sample theory enables us 10 
emphasize the rigor of the experimental design 
instead of the size of the sample itself. Теп thou- 
sand subjects in an ill-planned study may yield 
results more equivocal than 40 subjects ina care- 
fully designed experiment. 


Pre 


paration for Classroom Experimentation 
LM ог Classroom Experimentation 


There are many experiments you can do in the 
Classroom. Most of these probably fall within 
the category of action-method studies, but some 
may be of more genera] import. Remember that 
the generality of your findings is inextricably 


bound up with the formulation of the problem; if 
you strive for 


than viewing 
merely loca] 


these matters well. Unfor- 
not many such persons avail- 
ore than 100 educationalists 


Магеһ, 1957) 


Де шене United States. А possible solution 
Course e statistics and experimental design 
universi E the psychology departmentof a major 
However у. Collaboration 15 the desirable plan, 
able eA ae though you do acquire consider- 
Orts mo sophistication. 4 Cooperative ef- 
er benefit as the speech study I described earli- 
n ню all persons involved immensely. 
your ӛлу event, it is essential that you design 
“turn ною thoroughly before beginning to 
Starteq Жү кей and that all collaboration be 
the the very begining, rather than after 
Always € in. As the statistician must nearly 
too late dd the researcher who consults him 
ве Бае тег the experiment has been m і sman- 
e saddest Of all sad words of tongue or pen, 
‘ddest are these, it might have been." Or- 
А Specialist in experimental design 
as you, bur Your subject matter field as well 
methodolosi can point out logical flaws and 
all your Б. ық imperfections that might nullify 
herwise commendable efforts. 


Cecspitulation 

Thi 
опто рег has been concerned entirely with 
умев I ere P erimentation in the classroom, 
borim ieve we have neglected to our great 
ist based Most decisions about methods have 
ta ative c Чроп colloquial, anecdotal, ог admin- 
с Чоп, ета derations rather than experimen- 
со porated lom are adequate control groups in- 
io ity or ща classroom experiments. Thene- 
i usually Ong-range experimental design is. 
meets: appreciated by teachers and adminis- 
ma Чер € principle of randomness is often 
Wo Ching 004 or ignored in favor of elaborate 

pret of ; ү Мов has several disadvantages: 

egr few teachers, including those with 
екран get even minimal training for 
is viste дақ Our professional lit- 
ie st ually devoid of well controlled ex- 

а in the classroom. We contin- 

S» ratin Orance via conferences, question- 
ye Corre]: Scales, opinionnaires, and inef- 

ог ec d studies, all of which аге 
ег N selves, rtain purposes but not sufficient 

a 

хоса Чопа, ү advance beyond the dark ages of 
otp mental €-science, we must emulate the 
е pee proficiency and zeal of colleagues 
бор, Bk; dune Sciences. Ours is a distint- 
Peri, Only oe has its own problems 10 
viq s entally У close collaboration between €X- 


Thay Prea aware ls та 
dr persons at all levels 
the «Dead esearch partnership can we hope to 


achin, y against the vast complexities of 
earning process. 


STANLEY 


FOOTNOTES 


1. If there are no significant interactions, the 
‘main effects” are additive. Suppose, for ex- 
ample, that girls are superior to boys, per- 
sons taking speech are superior to those tak- 
ing English, and the “followed” group is su- 
perior to the <“поп-іоПоуей” group. Then, if 
interactions are nil, the best speakers willbe 
the girls taking speech and being followe d. 
The worst speakers will be the boys taking 
English and not being followed. However, 11, 
despite the general superiority of girls, 
speech, and following, the boys taking English 
and not being followed were the best speakers, 
we would havea triple interaction (sex, speech, 


and method). 
Two-factor interactions may also occur. 


Girls taking English might be superior to girls 
taking speech, despite the overall superiority 
of the speech group over the English group. 
Also, boys being “followed” might be better 
speakers than the followed girls, despite the 
overall speaking superiority of the girls. Or 
those persons taking English and being fol- 
lowed might be better speakers, regardless of 
sex, than those taking speech and being fol- 
lowed, even though for the experiment as a 
whole the speech group is superior to the Eng- 


lish group. 


2. **Opinion Constancy After Form al Role 


Playing, » Journal of Social Psychology 
(in press). 


i e speech study, one must not overgen- 
ы AS іп the results of the Stanley-Klausmeier 
investigations. Definite limitations were set 
py the type and small number of subjects used, 
the formal nature of the role playing situation, 
and the opinion area involved. Janis and King, 
studying «The Influence of Role Playing on 
Opinion Change, » [ Journal of Abnormal and 
gocial Psychology, XLIX (1954), pp. 211-18] 
with small groups under non-classroom con- 
ditions, found evidence for such change. For 
a recent review article that contains 22 refer- 
ences, See J. H. Mann, “Experimental Eval- 
uations of Role Playing, ” Psychological Bull- 


etin, LIII (1956), РР. 227-34. 


i -design “ 15” in 
the е erimental-design exper 
ш ЕР Сашо ала psychology consult each other 
sni the mathematical statisticians frequently. 
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RECENT TECHNIQUES FOR ANAL 
YZING AS- 
SOCIATION IN CONTINGENCY TA BLES ÀS 
APPLIED ТО AN ANALYTICAL FOLLOW-UP 
SURVEY OF EDUCATION GRADUATES: 


SAMUEL T. MAYO 
Loyola University 
Chicago, Illinois 


Introduction 


THE 
SCribe ИВО of Ше present paper is to de- 
Sociation in қығы techniques for analyzing as- 
eir applic cep eg tables and to illustrate 
Problem ation to an important educational 
to t evaluating the h i 
һе occupati g uman product relative 
teacher. t pational destination of graduates ofa 
The Minds ie institution. 
the Present i of statistical techniques used in 
Өпшпегану Investigation are those applicable to 
fables, NETS data in the form of contingency 
tributes, T are classified on the basis of at- 
Siten ас че concept of attributes will be con- 
Contingen ere in this manuscript. The use 
e is not dais to analyze categorical 
Тв to the wo dating back some forty-odd 
th Че fun me Ork of Karl Pearson. However; 
55. theory m work on the improvement of 
w. таз to һау applications of contingency tables 
TL Tro sid been done until just after. World 
wophiques 5. time а number of significant 
ex kers in the fi een developed by statistical 
fu] Te which ields of biometrics and agri- 
Е сав of the аа to greatly extend the use- 
ple Enized ir мелер table. It should be 
user Y Such t there is no reason, in princ i- 
cilness in M DI аны should not find great 
тас Square e behavioral sciences as well. 
Sifieq опаПу Т usually employed, has been 
time „ОП the bari ed to contingency tables clas- 
the апа consistin of only two attributes at à 
iar ,eSulting disa оға ‘агре’! sample. Among 
Plication е vantages of this more famil- 
a WM contingency tables are these: 
le surga Chi-square t i 
8 ers from th est for a contingency ta- 
respo, t departu e weakness that it covers all 
ifieg n dingly in re from expectation and is cor- 
а: ре. Sensitive to departures of a зрес- 
are нау tabl я | 
Peg 18ћег-отде ез, analyzed piecemeal, ig- 
„3. а more ws interactions, which involve 
n beta Large ributes simultaneously. 
Vio samples are not always available 


га 
* 1 research. 


The а 
the ор wis 


vestigate to acknowledge the help of 


ion upon which this paper 15 pasede 


pis advisor, Dre 


Some recently developed techniques consid- 
ered here serve to overcome these weaknesses 
Among these techniques are: 


1. Approximate tests of significance for contin- 
gency tables in which association is known to 
exist, so that the significance of departures 
of a specified type (e.g., correlation or ге- 
gression) may be tested; 


2. Approximate tests of significance for complex 
contingency tables involving various hypothe- 
ses among ав many as four attributes sim ul- 
taneously (i. €., tests of the significance of 
higher-order interactions); 


3. Exact tests of significance for *small" sam- 
ple data, or contingency tables with “әта” 
or zero theoretical cell frequencies and clas- 
sified on the basis of two or three attributes. 


The first of these types of techniques, those 
by which one may investigate departures ofapar- 
ticular type, utilize scoring schemes for rows 
and columns of the contingency tables. Such tech- 
niques have been described by Cochran (2), Stu- 
art (11), Yates (13), and Williams (12). Thetech- 
niques of Yates and of Williams willbe described 
and illustrated in the present paper. 

In the second type of technique, or those for 
complex tables for which one may test hypothe- 
ses involving three or more attributes simultan- 
eously, chi-square may be estimated by either 
of two approximate solutions. In one solutionas 
given by Bartlett (1), Norton (9), and Snedecor 
(10), chi-square аз а test for higher-order inter- 
action in a 2 X 2 x 2 table or the general 2n form 
can be approximated by solving а higher-order 
equation. Thus, in the 2 X 2x2 case, one would 
solve a cubic equation. In the other type of solu- 
tion, chi-square foranrxsxtxu (or four- 
way) contingency table with any number of cate- 
gories per attribute can be estimated by appli- 
cation of the likelihood ratio criterion as de- 
scribed by Mood (8) and Doi (3). 

In the third type of technique, or those com- 


palmer Oc Johnson, in the carrying out of 
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prising exact tests, one considers the exact rel- 
ative frequency of a selected configuration of 
cell frequencies among all configura tions de- 
duced from the observed marginaltotals, which 
are used as ancillary statistics. The con cept 
was first introduced by Fisher (4) for the 2 x 2 
case and has been extended to more c omplex 
cases by Freeman and Halton (5). 

These techniques will now be described inde- 
tail and illustrated elsewhere in the manuscript 
by the survey data. 


Scoring Techniques in Simple 
Contingency Tables 


The significance of association between two 
attributes in a simple (or two-way) contingency 
table can be tested by the usual chi-square test. 
However, chi-square is an overall test of all 
forms of departures from expectation. Under 
the null hypothesis that the two attributes are 
not associated, the expected frequencies in any 
row (or column) are proportional to the margin- 
al frequencies. When one rejects the null hy- 
pothesis of independence and association is as- 

sumed to exist between the attributes, it is of 
practical importance to be able to specify the 
nature of the association. Williams (12) main- 
tains that the interpretation of the data is simp- 
lest if the association can be accounted for in 
terms of the correlation between a Single pair 
of variates corresponding to the two attributes, 
In order to make this interpretation, one must 
make the assumption that both attributes are 
based on characters which are either directly 
quantitative or are in the form of gradings which 
can be regarded as having an underlying quanti- 
tative basis. Williams shows that Significance 
tests, developed for discriminant analysis and 
for the interpretation of interactions, exact when 
the variates involved are normally distributed, 
may be applied as tests asymptotically exact to 
contingency tables. 

The methods of Yates (13) and Williams (12) 
differ in the manner of determining the Scores 
for rows and columns. In the Yates’ method the 
scores are chosen arbitrarily. Yates has point- 
ed out that any system of sco ring may be as- 

E { the classifications. In the Wil- 
signed to each о 

iams' method, on the other hand, scores are 
2. d empirically from Ше data and must sat- 
were Аи, The empirically-derived 
isfy certai e to maximize the correlation сое!- 
rae pa from a given set of data. Thus, 
{оу сап be brought into closer сопсогдапсе with 


метри: Method of Scoring Simple Contin- 


i tation of Yates 
icy Tables— The symbolic notation of Yate: 
ney Tied л! to be more consistent with 
п ms as well as with Ше usual statisti- 
The notations used here were as 


ge 
was modi: 3 
that of Willia 


cal symbols. 


follows: 


пі) observed frequency in ith row and jth 
column 

ni. total frequency in the ith row 

n.j total frequency in the jth column 

хі arbitrary score assigned to the ith row 

уі arbitrary score assigned to the jth col- 
umn 

B numerator of the formula for regres- 
Sion coefficients of yj on хі and xj on yj 


A denominator of regression formula for 
yj on xj 

А! denominator of regression formula for 
хі оп yj 


Бух regression coefficient of yj on xi 

bxy regression coefficient of хі оп yj 

г number of rows in contingency table 

5 number of columns іп contingency table 
a Significance level for a particular t 


The Yates’ symbolism for a 3x 3 contingency 
table with assumed arbitrary scores being the 
Series -1, 0, and +1 for both rows and for col- 
umns is given in Figure 1, 

The quantities A, А" » and B are calculated by 
the following expressions: 


А зп. б жі, - (Z ху)? 
1 


А! 


2 + = : 1 2 
п. ФУ.) - ур. 


В =n. тен yjnij) - (Z xni. )Z yjn, j) 
i 1 


The two regression Coefficients are given by 
bxy = B/A 
and byx - B/A' 


To test whether each regression coefficient is 


significantly different from Zero, we first com- 
pute the standard error of each regression coef- 


ficient and then apply the t test. The standard 
errors of the Coefficients are given by 


5.Е. of bxy = УА" JAn., 
and S.E. of byx = УА/Ат па 


апа Ше Corresponding t ratios are given by 


{= bxy 
ВЕ. оғы 
b. 
and t- SEL 


yx 


March, 1957) 


The t 
5 are not differentiated by subscripts, 


Since t š 
ред аы will be numerically equal when ар- 
are тер, rien set of data, The obtained t's 

ed to either the t table with infinite de- 


Brees of 
bles, freedom or to the normal probability 


After Wi 
nt populatio 


ave estimated the magnitude of the 
variate upon the other in the par- 
errors of Bue we may further inquire asto the 
tota. variatio, estimate. Fiducial limits for the 
extremes А оғ yj accounted for by хі between 
multiplyin both variates may be estimated by 

(8-1) Е b and its standard error Бу (г - 1)= 

St, then computing 


b + (6.Е. of b) 


Апац 
й е і 
sociation де test of significance of Ше as- 
hi-g ware W and column scores is given as 
With 1 degree of freedom by 


How X° = Bn /АА" 
ever ; ww 
if р 
ева е ts for testing the significance 
Pon ed, we Pere have already beencal- 
Te by m Obtain this same value of chi- 

ца е Жашы Squaring t. 

Wil тасу Tables Method of Scoring Simple Con- 
Methor® method The symbolic notations for the 
ls are the same as for the Yates' 


> With t 1 
хі à he following exceptions: 
en 

у, for Otes empirically-derived score 

j o ith row 
r fop otes empirically-derived score 
x г the 

y d jth column 


e 
T TOW ве; the correlation between the 
te Matri ores and column scores 
t 1х ñ 
trix z they азба will be explained in the 
s. text ™bolism еаг. Further explanation of ma- 
ла 019 by Gund algebraic rules may be found 
wits м ашы (6:160), Mood (8:110-176) 
Та ; e Y. мара 
азоо аа athens method, the first step in the 
ay de n 15 to make an overall test of 
Ше nn insure usual X? test. This is done 
tin, $ Dri. eithe, that association does, infact, 
и епеу агу an the Yates’ or Williams’ meth- 
. CY table», ал aid to interpretation of a con” 
еге association is known to ех" 


of th 
е TN 
ее не. Е opera Pirical scores proceeds by 
Чеда "ы iginal г м with matrices. | 
еп 18 transf S contingency table with ele- 
Biven by ° ed to the matrix G with 
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This amounts to dividing each cell frequency in 
the contingency table by the geometric mean of 
the row total and column total for that particu- 
lar cell. 

The matrix G is transformed to matrix T by 
the matrix multiplication 


T = GG' 


This formula says that matrix T is obtained by 

multiplying G by its transpose. The transpose 
of a matrix is obtained by making its rows into 
columns and its columns into rows. Each ele- 
ment in the T matrix is obtained by following the 
rules for multiplying two matrices. Mood (8) 

has stated the definition for matrix multiplica- 
tion in general as follows: 


ement in the ith row and jth column 
of the product matrix is obtained by mul- 
tiplying the elements of the ith row of the 
left-hand matrix by the corresponding ele- 
ments of the jth column of the right-hand 
matrix and adding the results. 


The el 


In order to calculate the scores for rows and 
columns of the contingency table which would 
maximize the correlation betweenthe two scores, 
it is necessary to solve for the second largest 
ot of the matrix T. We shall designate 
this root by the symbol X. This root is equal to 
the maximized correlation coef- 
and the latent vector of this root gives 
set of scores for the rows. Col- 
s are calculated from row scores 


score 
pn te formula, which will be given 


by an appropria 
ently. 
subset 7 we obtain the characteristic 
ix T by first subtracting the un- 
ity > from each of the three terms 
in diagonal of T, then by treating the 
ulting matrix 25 a determinant, and finally 
ру expanding the determinant to yield the char- 
acteristic equation. 


n the numerical value of à has been de- 


o the desired degree of accuracy, the 
scores are found for a set of solutions bi to 
өтер jmultaneous equations 


(20 {ri} = 9 


а set of scores 


and finding 
xi = kbi 
i t the restrictions 
:onal to the bj's so tha 
proportion 
z ni.Xi = 0 
i 
2 
Уц. P. 
and Р 1.21 
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are satisfied. 
The column scores are calculated by the re- 
lation 


yj= £ nijxi/rxyn. j 


and the obtained scores must satisfy the restric- 
tions 


Zn ще 0 
ала zn jj^n. 


A check on the accuracy of the Scores is giv- 
en by the formula for the correlation in terms 
of row and column scores as given by 


Гху = Z Z njixiy;/n 
xy ji ijuyj/n | 


which should be numerically equivalent to Vy . 

Williams showed that the formula for testing 
the significance of the association of rowandcol- 
umn scores which was given by Yates as 


X° = Вёһ /Ал! 
is equivalent to testing 


ще 2 

Х - по ry 

as a chi-square with one degree of fr eedom. 
Since гху is also a correlation coefficient, anal- 
ternative test is to treat 


(n, .- га) 
F= тт 


as an Е with 1 and n, -2 degrees of freedom. 


Higher-Order Interactions in Complex 
Contingency Tables 


Whereas in a two-way contingency table, we 
test the hypothesis that there is no association 
between the two attributes of classification, which 
i ivalent to saying that there is no first-order 
in ПОВ between Ше attributes—in а complex 
Ш йе, we may test Ше hypothesis that there is no 
h. падат interaction among the Severalattri- 

= Several different kinds of higher-o rder 
a tions may exist, and later these will be 
uà red when the likelihood ratio criterionis 
крана. First, however, Ше 2 X 2 x 2case will 
а А 


і а. | | 
а поти А Interaction in the 2 x 2 х 2 Соп 
е 


псу Та e— The method of testing second- 
tinge 
ingen) — 
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Order interaction for the 2 x 2 х 2 contingency 
table is due to a method suggested by Bartlett (1), 
developed by Norton (9), and illustrated by Sned- 
есог (10). The symbolism of these authors is 
followed in the present paper. 

Consider, first, the two fourfold tables with 
cell contents а, b, c, аапаа' з t, m, 6 те- 
Spectively, as shown in Figure 2, where the no- 
tations are given as follows: 

А,В,С denote the three dichoto- 
mized attributes 

i,j,k denote numbers of the cat- 
egories of the three attri- 
butes, respectively, which 
take on values of 1 or 2 
denote the cell contents of 
the first 2x2 table of attri- 
bute C 

denote the cell contents of 
the second 2 x 2 table of 
attribute C 

denote the parameter val- 
ues of the probabilities of 
а case from sample N fall- 
ing in the indicated cell 
denote the parameter val- 
ues of the probabilities of 
a case from sample N' fall- 
ing in the indicated cell 


a,b,c,d 
a',b' ,c',d 


Ра» Pp; Po, Ра 


Pat» Phr Ре", Pg 


Each of the 2 x 2 tables which is classified by the 
two attributes A and B may be examined for in- 


ed are 


Рара = Рьрс 


and Ра Ра = Dp! Por 


respectively, 


In the theory being followed, the sample esti- 
mate of first-order interaction is the ratio 


a/b: с/а = а/с: b/d = ad/bc 


Aside from the con 
errors of Sampling, 
(X? = 0), then ad/be 


é Tom that in the other. 
The ratio of these first-order interactions 18 


known as the second-order interaction. The 


sample estimate of the Second-order interaction 
is 


ad/bc 


a'd'7brc* = адю с" /а d'be 
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FIGURE 1 


SYMBOLISM FOR YATES' METHOD WITH AN EXAMPLE OF NUMERICAL SCORES 


1 
(Score)? 1 0 
+1 
lium. Score -1 9 
Е S 
зум. 3core 7і 72 3 Total lean 
Score 
(Зсоге)2 Nun, Sym. Score 5 n 
1 ni 37 2-75) 1. 
+ x ы 
ab 
жаған У 723/22. 
0 0 % “е J 4 
1 пу, Y 535 Ў тууа, 
=l x j J 


“з 


1. аб 


хуп, 
Total Зсоге 240 pra > 1943 


x, n. 
жыла жыт i 4145 


n 


z- —— Re 
Mean Score : і 
na 0,2 1 
FIGURE 2 
y TABLE 
SM FOR А 9 x 2 x 2 coNTINGENC 
SYMBOLI 
с 
2 
+ 
k= | 
В 
j= ER 2 
i= Ц а с ра 
i 2| b à |n 
з N 
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Before proceeding to the presentation of the 
test of significance for second-order interac- 
tion, it will be well to explain the concept of de- 
viations in 2 X 2 tables. Ina 2 x 2 table the de- 
viation (or difference between observed and the- 
oretical frequency) is the same in absolute mag- 
nitude for all four cells. Let this deviation be 
symbolized by 


X = fo- ft 


where fo denotes the observed cell fre quency 
and ft the theoretical or expected cell frequency. 
The algebraic sign of x is positive for One pair 
of diagonal cells and negative for the other pair, 
so that 


22 
Z Z x;; = 0 
res 


It is easy to construct a table of expected num- 
bers in which the interaction ratio is 1, as fol- 
lows: 


a-x b+x 
сах а-х 


The quantity x for agiven 2X 2 table could be 
computed by Solving the equation 


(a-x(d-x) | 
Б+х)с+х = 


which may also be expressed in the form 
(а - x)(d - x) = (b + х)(с + x) 


Ву analogy it may be shown that there isade- 
viation x common to all eight cells of a pair of 
2x2 tables considered jointly asa 2x2 x 2; 
The analogous equation to solve is the cubic 


(a - x)(d - xe' - x)b' -x) = 
(c + x)(b + x)(a' + x)(d' + x) 


This equation is easily remembered by a rule 
of thumb which indicates that in the left-hand 
member the letters follow a diagonal downward 
in the first 2 х 2 table, then across and upward 
in the second. Methods for approximating the 
real root of this cubic equation may be found in 
any college algebra book. Essentially, they con- 
sist of trying various values of x until two are 
found between which the left-hand member of 
ion changes sign. 
шо been calculated to a sufficient 
number of decimal places, the adjusted chi- 
uare with one degree of freedom for second- 

ea interaction is given by the formula; 


= 


и л ъ 1 1, З 
бы "(a d-x* c'-x* b'-x + cox * ех 


1 1 
+ а'-х*@-х 


If the chi-square for Second-order interactionis 
not significant, the pair of 2 x 2 tables may be 
combined into a single 2 x 2 table and tested for 
first-order interaction. 

Likelihood Ratio Criterion for a Four- Way 
Contingency Table—In the foregoing section th e 

X 2X 2, a special case of the three-way contin- 

gency table, was considered. А general means 
for testing several kinds of hypotheses forafour- 
way table by the likelihood ratio criterion will 
now be considered. It should be noted that the 
method is also applicable to three-way tables. 

Consider a four-way contingency table class- 
ified by the attributes A, B, C,.and D as shown 
symbolically in Figure 3, where the notations 
are given as follows: 


A,B,C,D denote the four attributes 
Categories of attributes are denoted by sub- 
Scripts as follows: 


А--(і-1,2,... r) 
В--0=1,2,. .. ,8) 
C--(k-1,2,. . . ;t) 
D--(hs1,2,. . . 7) 
пука denotes the frequency in the cell 


Common to the ith row, jth col- 
umn, kth category of attribute C 
and hth category of attribute 
D 


Marginal totals were denoted by replacing the 
Summed index by a dot, e. 5., 


u 
пік, = Я nijkh 
ut 
Rij... = £ Z nijkh 
Ud sr 
n = 
ее V Ë $ $ P npa 


Probabilities for 


Particular category values are 
expressed by app d 


ropriate Subscripts, e.g., 


Ріїкь denotes the probability of ап indi- 
vidual’s being in the ijkhth cell 

РЪР РК Ри denote the probabilities of an in^ 
dividual’s being in the categories 
1, j, k, and h, respectively 

x denotes the likelihood ratio 


Six kinds of null hypotheses can be tested in 


wor n5 2o mno, “21.2 722.2 


13.22 P3..2 131.2 732.2 


95.12 
n io 1,122 1,222 "..22 "...2 5.3.2 520 
B sls E Bote opus 
с 
Ват 5,01. nio. 1,22. 
Буут. "121 П112. P3122. “Т 
1211. 221. 1212. 222. ПО аз 
n 
Diii, 321. 1312. P322. Эа 
Diis Это, 
D51.4 020.4 
n3. s n32,, 
DY ls 21.2. 
AB ls 92,2. 
n, . 
953. 3.2. 
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FIGURE 3 
SYMBOLISM FOR A FOUR-WAY CONTINGENCY TABLE 
с 
kel 2 
B B 
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| 21 = 
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Ше four-way contingency table by Ше likelihood 
ratio. They may be stated verbally as follows: 


1. The four attributes are mutually independent. 

2. Three of the attributes are mutually independ- 
ent. 

3. Two of the attributes are independent. 

4. One attribute is independent of a classifica- 
tion formed by combining the other three at- 
tributes into a unit. 

5. One attribute is independent of а classifica- 
tion formed by combining two of theother 
attributes into a unit. 

6. The combination of two attributes is independ- 
ent of a combination of the other two. 


Each of the six kinds of null hypotheses will 
be considered separately. In addition, each will 
be illustrated by examples of the hypotheses 
stated in terms of probabilities andan example 
of the calculation of the chi-square to test the 


(1) loge Пр: = 
а 
( 2) loge Па |” = 
п.к. 
( 3) loge qn k = 
п..ь 
( 4) loge E n h E 
Djikh 
( 5) loge ijkh iih = 
n. jkh 
(6) loge пай = 
° kh М 
пі. kh 
(7) loge a ALMA = 
ijh 
( 8) log, ch Dij^h = 
nijk. 
( 9) loge Ж Nijk. = 
nij 
(10) loge п nj. > 
т.к. 
(11) loge g Nox. = 
пі. 
(12) loge = nj. ph = 
іһ 
n, jk. 
(13) loge it n, jk. = 
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hypotheses by ап approximate method. When 
stating one of the hypotheses in terms of prob- 
abilities, one assumes probabilities ofa case be- 
ing in one category or in another category as be- 
ing independent of each other. Then, by a well- 
known theorem of probability for c ompound 
events as shown by Mood (8:34), the null hypoth- 
е515 may be stated by a proposition denoting that 
the compound probability (i.e., the probability 
of a case's being jointly in a certain pattern of 
Categories) is equal to the product of the proba- 
bilities for the Separate categories. 

Ав an intermediate Step in estimating chi- 
Square for the various hypotheses, we calculate 
the likelihood ratio X in the present method. It 
can be shown for complex contingency tables 
that in large samples the quantity -2 loge > ap- 
proaches the chi-square distribution withappro- 
priate degrees of freedom. Allofthe terms 
necessary to calculate X for any hypothesis are 
given by eighteen expressions as follows: 


.30258 H ni logign; . 
. 30258 бад. logion у, 
. 30258 Zn_k 108101, „к, 
. 30258 EU. logion, , в 
. 30258 Рат logighijkn 
‚30258 да jkh logy gn, jkh 
‚30258 й Di. kh logioni, kh 
. 30258 & nij.h logigni. jh 
. 30258 td пк, loglonijk. 
. 30258 Е nij logignij.. 
- 30258 б Nik. logion x, 
‚30258 ү Эһ. ПОЕТО h 
. 30258 2 n, jk. 106100, jk, 
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(14) 
(15) 
(16) 
(17) 


(18) 


Descrip 

criptions of the algebra necessary to test 
о Six kinds of hypotheses along with 
e examples are presented below. 


Sach of th 
арргоргіа 


а. Are Ше four attributes mutu- 
ally independent? 


loge 


loge 


loge 


loge 


loge 


The 
null hypothesis tested here is 


H: Pijkh = p; 
й PiPibkPh 
lie Ninus 
e likelihoog ratio is 


= 
Un, 1: 
Қар 


(п. "EE 
" E 
and jo төш -(r+s+t+u)+3 
тыны Су e ыы 
1-5 


Calo ete fort 


ated b 


Ure for 


n 
q nj 


jh п... m. h 
% )OTn..k. Min... ) 


ae Ip ен 


testing the above hypothes 
pr аа = -2 106еХ. The same р 
Priat ating each chi-square from the ар- 


е 
À was followed throughout. 


b. 
Are three of the attributes 
mutually independent? 


Fo 
t ur h 
hos ypotheses may be tested here, namely 


ang at 


esti 
с. А ing the mutual independence of 


D УА, 
В, and D; B, С, and D; ог А, 


th S an 
he m example, the hypothesis for testing 


ut 


H. 
Шы, 
ЗК pipjpk 


е 
9:2 associ 
yd egi Contingency table may be thought 
їх. The presi table with cell freque ncies 
ikelihood ratio is 


(пай. ; 
X. Ты а. 


<. 


чат і 
1 independence о! A, B, and C is 


Эш, e 


gr s жана 
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2.30258 Zn jh logioh, j. h 
2.30258 Хп. kh 105100, . kh 
(2. 30258)(п.... logion....) 
(2. 30258)(2n, ... 108100...) 


(2. 30258) (3n, ... 108100...) 


with df = геш - (r + S + t) + 2 
and loge > = (1) + (2) + (3) - (17) - (9) 


с. Are two of the attributes 
independent? 


Six hypotheses may be tested here, nam ely, 
those testing independence of À and B, À and C, 
A and D, B and C, B and D, and С and D. As an 
example, the hypothesis for testing the independ- 


ence of À and B is 
H: pij = PiPj 
The likelihood ratio is 
Dis n, j.. 
(nj, 9 
i 


dE ll 22 
nij.. 
(n... эш а? 


ith df = (r - 1)(s - D 
and loge > = (1) + (2) - (16) - (10) 


а. 15 опе attribute independent of a class- 
ification ormed by combining the 


other three attributes into a unit? 


Four hypotheses may be tested here, namely, 
those testing the independence of A from (B, C, 
D); B from (А, C, D; С from (A,B, D); and D 
from (A, В, C). Азап example, the null hypoth- 
esis for the independence of A from (B,C,D) is 


H: Pijkh ~ pjPjkh 

here pijkh 15 the probability of an individual's 
being in the ijkhth cell, pj the probability of being 
in the ith category of attribute А and ріки the 
probability of being jointly in the jth, kth, andhth 
categories of attributes B, C, and D. 


The likelihood ratio is 
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š n. jkh 
ni... >J 
IIn; ll "CI n, жа) 

ш E cs jkh 1 


) 


€— Njjkh 
LOG Pijin 


ith df = (z - 1)(stu - 1) 
died ав ої 


е. Is one attribute independent of а class- 


ification formed by combining two 
of the other attributes into a unit? 
ee See мио а ие 


Twelve hypotheses may be tested here $ 
namely, those testing whether À is independent 
of either B and C, B and D, or C andD; whether 
B is independent of either A and C, A and D, or 
C and D; whether C is independent of either A 
and B, A and D, or B and D; and whether D is 
independent of either A and B, Аап С, or B 
and C. As an example, the hypothesis for test- 
ing the independence of A with B and C is 


Н: pijk = PiPjk 
where pijk is the probability of being in cells 
formed by summing over the h's and Рук is the 
probability of being in the joint jth and kth cate- 
gories of attributes B and C. 
Тһе likelihood ratio 15 
п... п. ik 
(Пп; )ün К. 
р ін jk .jk. ) 
м = 


Шад II 
ще Nij. h ) 


with df = (r - 1)(st - 1) 
and loge à = (1) + (13) - (16) - (14) 


f. Is a classification formed by the com- 
bination of two attributes independ- 
ent of a classification formed by 

the combination of the other 
two attributes? 


Three hypotheses may be tested here, name- 
ly, those testing whether A and B is independ- 
ent of C and D; whether A and C is independent 
of B and D; and whether A and D is independent 
of B and C. As an example, the hypothesis for 
testing the independence of A and B with B and 


C is 
Н: pijkh = PijPkh 


Я m TR ith 
;; is the probability of being in те it 
еру нед of attributes А апа B jointly 
ап on the probability of being in the kth and 
ап 


hth categories of attributes C and D jointly. 


(Vol. 25 


The likelihood ratio is 


nij. D... khi 
q nij.. (Пт, kh ) 
1 
зе 
NH ла nijkh 
(0 ii XGI арка ) 


with df - (rs - 1)(tu - 1) 
The Exact Method of Freeman and Halton 
ee 22010100 01 Freeman and Halton 


The method of Freeman and Halton (5) is an 
extention of Fisher's exact method for the 2 x 2 
Case to tables with any number of attributes and 
any number of associated categories. It applies 
to any sampled array of numbers, whatever the 
population from which the sampling is eff e cted, 
provided that: (a) either the parent population is 
infinite, or the sampling is done with replace- 
ment of the sampled members; and (b) the sam- 
pling is random. 

Like Fisher's method, a special case of the 
present method for the 2 x 2 table, Freeman and 
Halton's method is applicable to tables which 
have theoretical frequencies so small that the 
chi-square test is not appropriate; even tables 
with some zero Írequencies can be handled. Ac- 
cording to the authors, the only difficulty in us- 
ing the method is the amount of computational 
labor for dealing with large samples. 

The method in general consists of assuming 
the border totals fixed, considering only relation- 
Ships internal to the contingency table, consider- 


ing every possible array of cell frequencies with 
the given border totals, 


significance as follows: 

the same genera] conditi 
Same border tota. 
Sri probabilities are 


as follows: Тһе 
to a ratio where 


quencies. 


The formula for с 


9mputing the probability of 
having obtained any 


array through random sam- 


- — - o ЕЕЕЕШЫСЕРШИСИНИРНННИЬИ С 
з 5 p a 

ж ——— 

с ее ----4 
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li 
Pling from a set of all arrays with fixed margin- 


al to i i F 
v it is given symbolically for the two-way 


ani : 
d for the three-way case as 


Tni, b Hn, з, Па. де 


йыз э Нак Mob 


(п...) 1 ' 
Hue 


P = 


D 
sign of the Survey 


The . 
quég Hof uestions Under Investigation— The 
hypothe under investigation from which the null 

S were deduced were these: 


Are 1 

ау tes indicating the extentto which 

aching utilized their training in actual 

Which oe related to those attributes 

their ге known about them at the time of 
graduation? 


* Are th P 
€ attributes which were known about 


Sraduat, 
errelated? the time of their graduation in- 


` What 
У 
tering сее the reasons for graduates’ not en- 
е ог m Ching or for failing to teach during 
Ore of the first five years? 


Бекегі А 
of ete pon of the Variables—The variables 
(attributes: (1). were considered as two sets 
с. POStgraqu (1) pregraduation attributes, and 
adu аба Шоп attributes. The twelve pre- 
n attributes were 


Year graduated 


Qua 
Sex rter graduated 


Major field 


Оп 
res at commencement 
аш ДЕ degree 

Age With major peer group 


Teach; 
aching previously 


urati 
Mili of previous teaching 
ry service 


Xtra. А 
Curricular activities 


A EA 
IM = © Ф co = O сл #5 со о ке 


Тһе 
fou 
E. т Postgraduation attributes were 
2; Taught si 
EN Taught m graduation 
Taught uring fifth year 
Continuously 


MAYO zs 


4. Intention toward future teaching 


радаре 
will be defined. й ий 22 

Тһе (егіп *'attribute'"' in Ше present paper re- 
fers to а set of mutually and exhaustive “са е - 
gories", so that any person in a sample of indi- 
viduals can be classified as belonging in only one 
category of a given attribute. The simplest 
form of attribute is the dichotomy, and most of 
the attributes considered here are of this type. 
Thus, a person either has or does not have the 
characteristic specified by the attribute. For ex- 
ample, persons were classified on the basis of 
*thonors" by the categories “уев” and “по”. 
Placement in category tyes” means that the per- 
son had honors conferred at commenc em en t 
while “по” designates that no honors were con- 
ferred. The process of classifying persons into 
categories of an attribute involves the operation 
of counting the discrete number of persons in 
each category. This operation is fundamentally 
different from the process of measurement 
where a scale of more or less equal units is 
applied to a person or object and the measured 
number is an approximate number involving a 
whole number and a decimal fraction, such as in 
length the quantity 6. 54 inches. 

When a sample of individuals are classified 
on the basis of two attributes simultaneously, we 
count the number of persons who may poss ess 
jointly any of the possible combinations of pairs 
of categories. Again, it should be noted that 
classification is mutually exclusive and exhaus- 
tive. Thus, any person or object would be count- 
ed once and only once for any given contingency 
table. 


The pregraduatio: 
putes which were listed previou 


described briefly. 
The first of the pregraduation attributes was 


“уеаг graduated." A year here refers toa per- 
iod beginning with a December commencement 

and extending through an August commencement. 
The particular years given are the years during 
which the August commencements fell. This at- 
tribute was а dichotomy, and the two categories 


were 


n and postgraduation a ttri- 
sly will now be 


1948 
1949 


The second pregraduation attribute was ‘‘quar- 
ter graduated. » This refers to the session dur- 
ing which the degree was conferred. The two 
summer sessions were treated as quarters. The 


five categories were 
Fall 
Winter 


Spring 
Summer Session I (July commencement) 
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Summer 5е55іоп П (August commencement) 


The two categories of the third attribute, 
вех’? were 
Male 
Female 


The fourth pregraduation attribute was “та- 
jor field.” The fifteen categories were 

Art education 

Business education 

Elementary education 

English 

Foreign languages (French, German, Span- 
ish and Latin) 

Industrial education 

Mathematics 

Music education 

NKP (Nursery-kindergarten-primary) 

Physical education (men) 

Physical education (women) 

Science 

Social studies 

Speech 


Special fields (speech pathology and handi- 
Capped children) 


The fifth pregraduation attribute was ''hon- 
ors at commencement, ›› The two cate gories 
were 

Honors conferred (Yes) 
No honors conferred (No) 


The sixth pregraduation attribute was “рге- 
vious degree.’’ This attribute refers to a grad- 
uate’s having had a bachelor’s degree previous 
to earning the B.S. in Education degree. The 
categories were 

Had previous degree (Yes) 
Had no previous degree (No) 


The seventh pregraduation attribute was 
“rank with major peer group.” The ranks re- 
ferred to were obtained from rank-order 115 ts 
submitted by the major departments to the Bur- 
eau of Recommendations each spring. The three 
categories were 

High 
Medium 
Low 


ighth pregraduation attribute was “аве 
at Dt of graduation, ? Initially, this ЖАЗ а 
continuous variable, and Ше age was Ре ег- 
mined to Ше nearest whole year. T e "s 
f ages was divided into four class-i nterva S. 
ri хай, categories in terms of the limits of 
the class-intervals were 
20-22 years 
23-27 years 


(Vol. 25 


28-31 years 
32-59 years 


The four class-intervals for “аве” were treat- 
ed just as if they were categories of an attribute. 
The ninth pregraduation attribute was “taught 
previously." The two categories were 
Taught previously (Yes) 
Had not taught previously (No) 


The tenth pregraduation attribute was “ашга- 
tion of previous teaching.” Like “аре”, this 
was initially a continuous variable, and duration 
Was determined to the nearest whole year. The 
range of durations in years was divided into two 
Class-intervals, so that the attribute became а 
dichotomy. The two categories were 

- 4 years 
5-30 years 


The eleventh pregraduation attribute was 
“military service.” This refers only to mili- 
tary service during World War II or between the 
end of World War II and commencement. The 
two categories were 


Veteran (Yes) 
Non-veteran (No) 


The twelfth pregraduation attribute was ''ex- 
tra-curricular activities.” Evidence of partici- 
pation in extra-curricular activities was obtained 
from an open-ended question on the Registration 
of Recommendations. To be 
classified as a Participant, a graduate must have 
shown at least four acceptable activities from 


Scholarship or organizations, 
or physical education majors 
rart majors. The two cate- 


Evidence of marked participation (Yes) 
No evidence (No) 


The first of the Postgraduation attributes was 
е graduation.” This attribute маза 
wes n Which possession of the attribute 
indicates that the £raduate has done some teach- 
ing during the first five years since graduation. 
The two categories were 
ince graduation (Yes) 
Had not taught Since graduation (No) 

the postgraduation attributes 
i ng fifth year.” This attribute 
is a dichotomy in which possession of the attri- 
t the graduate was teaching 
ear after graduation. The two 
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Taught during fifth year (Yes) as follows: 
Did not teach during fifth year (No) ` 
| 1. Salar 
лз на postgraduation attribute was ‘‘taught 2. Working conditions 
355 stehe y." This attribute was treated both 3. Health (personal or family) 
the ер and asa dichotomy when either 4. Maternity 
саво two categories or the first and third 5. Military service 
а S were combined. The three categor- 6. Further study 
ib | 7. Marriage 
а ught continuously since graduation 8. Held non-teaching job in business or 
teaching service interrupted for at industry 


least one year 
Had not taught since graduation 


ак бенен, postgraduation attribute was “іп- 
Bolytom ard teaching.” This attribute was à 
Cases SU eI Бір categories, although in some 
Cilitate th gories were combined in order to fa- 
Up on the i analysis. The categories were set 
агеһу of PEE qup that they formed a hier- 
udes in ди graduation experiences and atti- 
actually i на d to the extent to which graduates 
ing in uma to apply their education train- 
80ries were eaching positions. The four cate- 

өреде during fifth year 

Not ой plan to teach in future 

lug ching; uncertain about future teach- 
Not teaching; do not plan to teach in future 


Po қ 
detinea пано апа Samples The population was 
9f the ier graduates of the College of Education 
Ples in ioe of Minnesota. The two sam- 

› each i eg we study consisted of two class- 
menceménts o including graduates from all com- 
waa Me one-year period extending 

€ August ommencement of one year through 
с commencement of the following year. 

о 


llect; 
tion and Analysis of Data 


Sour 
Collecte тесі Data—Pregraduation data were 
So ecommeny Personnel records in the Bureau 
me post тыр лудан of the University of Minne- 
даа в o 4 aduation data were collected by 
le ta Were d questionnaire. Pregraduation 
b tin, Pos vailable for every graduate; in col- 
Fa Sans o graduation data, attempt was made 
Cure at 1 persistent follow-up procedures to 
tionnaire. a 90 percent response to the mail 


b е entis. 
aan ña ure questionnaire was printed on the 
Vert e ne postal card. The instructions 
mal in Which ааа to indicate every school 
eve ting the he had taught since graduation by 
as ТУ year ' year from a list on the card. For 
ke to In which he had not taught, he was 
teachin indicate the reason or reasons for 
ч апу from а list of reasons given іп ће 
ing letter. The list of reasons was 


9. Suitable teaching jobs unavailable 
10. Other reasons (to be specified by re- 
spondent) 


Response to the Questionnaire—Of the 940 per - 
sons in the total samples for the two years, two 
were found to be deceased. Attempt was made 
to reach the remaining 938 cases by means of 
the mail questionnaire. 

Table I presents the number and percentage 
of persons responding to the ques tionnaire, 
along with pertinent information about the extent 
to which persons could be reached. Basedupon 
the estimated number of persons reached, the 
response to the questionnaire Was 91.3 percent 
for the total sample. 

Analysis by Simple Contingency Tables—In 
answering the first of the questions under inves- 
tigation, which concerns the relationships be- 
tween pregraduation and postgraduation attri- 
butes, analyses were made largely by means of 
simple, or two-way contingency tables; however, 
in some instances complextables were employed. 
A thorough analysis was made of associations 
between the more than one hundred possible 
pairs of attributes which may be set up from the 
twelve pregraduation attributes and the four post- 
graduation attributes, where associations were, 
for the most part, studied separately for the two 
years of graduation. Since these analyses in- 
volved merely the usual chi-square testand com- 
prise reiterative processes largely, a summary 
of the results of the complete set of analyses di- 
rected toward answering the first question under 
investigation is given in the present paper. De- 
tails of the tables have been reported elsewhere 
by the author (T). The results are summarized 
in Table II, where the probabilities of all signif- 
icant chi-squares are tablulated. 

It is appropriate here to specify the nature 
of the associations shown to be significant in Ta- 
меп. The evidence here, which bears upon 
the first of the basic questions, showed nearly 
all of the pregraduation attributes to beassoci- 
ated with one or more of the postgraduation at- 


tributes. 


The attribute *«taught since graduation" was 


found to be associated more often with the grad- 
uates who were female, who were not majoring 
in social science, who were younger, and who 
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TABLE I 
PARTICIPACION IN FOLLOW-UP STUDY OF P 
COLLEGE: sDUCATION Os THE UNIVaRSITY OF МІННЕЗОТА VITH THE 
B.S. IN SvUCATIUN DEGREE вит isiiN DEC#sBir, 1917, AND 
AUGUST, 1919, INCLUSIVE, AND AEGISTERING ITH THE 
BUREAU OF RECOMMENDATIONS 


ERSONS GRADUATING FROM THE 


ЕЕ — ооо ПС 
DID UM 


Per Cent Per Cent 
Category Number Total Contacted 
N = 9ho М = 916 
———O А 
Total number of graduates 
during period 9ho 100.0% ----- 
Number of graduates who 
could not be contacted 
by mail questionnaire 22 Bud (om Xm 
Number of graduates known 
to be deceased 2 0.002 ----- 
Number of graduates thought 
to have been contacted by 
mail questionnaire 916 97.7 100.0% 
Number of graduates 
for whom questionnaires 
were completed 836 89.1 91.3 
Number of graduates 
for whom questionnaires 
were not completed 80 8.5 8.7 


“Тре total sample included all majors from the iinneapolis campus 
except Nursing Education, Recreation Leadership, апа Library Science. 
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TABLE Il 


SUMMARY Or SIGNIFICANT ASSOCIATIONS BETJESN PREGRADUA'TION AND 
POSTGRADUATLON ATTRIBUTES AS SHOWN BY CHI-SQUARE TESTS IN 
SIMPLE CONTINGENCY TABLES FOR 1948 AND 1919 GRADUATES 


paduation Attribute 


Postg 
—— ——— == = = 
— рее, И И w 
e Graduation Graduation Year Teaching 
Year 
1 
Graduated 5 
Quarter ( 
years 0 
Graduated combined) a? 
Sex 1948 „001 „001 „01 
1049 .02 .001 .02 «05 
Major 
Field ар .01 2001 
Honorg 1948 „05 201 
1949 Ph 
Previou 
s 
| — SE. 
З aig „001 
1949 
А 01 05 
ве 1948 “001 2001 201 
1919 «091. ` 
i Taught 05 205 
Previously E 1001 001. 2001. 
Duratio 
n 
Teaching ioe il 
Nilit 
oo 03 e001 
Service De 102 1001. .02 „001. 
Extra. й 001 01 «001 
а 1948 “001. 205 201 


Curricular 1919 
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were not veterans. 

The attribute ‘‘taught during fifth year" was 
found to be associated more often withthe grad- 
uates who were summer graduates, who were 
male, who were older, who had taught previous 
to graduation, who were veterans, and who were 
participants in extra-curricular activities. 

The attribute ‘‘taught continuously” was found 
to be associated more often with the graduates 
who were male, who were older, who had taught 
previous to graduation, who had taught for a long- 
er duration previous to graduation, and who were 
veterans. Among all graduates those who had 
interrupted teaching service were found most 
often to be those who were honor graduates, who 
were non-veterans, and who participated in ex- 
tra-curricular activities. Of the social science 
majors who did enter teaching, less had inter- 
rupted teaching service. 

The attribute “intention toward teaching’’was 
found to be related to pregraduation attributes 

as follows: the females either planned to teach 
in the future (if not now teaching) or else were 
uncertain about future plans to teach; those who 
were ranked low in their major peer group 
planned not to teach in the future mo re than 
those ranked medium or high; older graduates 
planned to teach in the future; those who had 
taught previously planned to teach in the future; 
those who had not taught previously were either 
uncertain or did not plan to teach in the future; 
non-veterans were uncertain about future plans. 
to teach; participants in extra-curricular activ- 
ities were either uncertain or planned to tea ch 
in the future. 

Two simple tables will be considered in some 
detail, one to illustrate the exact method of 
Freeman and Halton, the other to illustr ate 
scoring methods. Тһе exact method is present- 
ed in this section of the paper, while scor ing 
methods are deferred until after the illustra- 
tions on complex tables. The reason for this 
particular order of presentation is that the 
data for the scoring illustrations depends upon 
the results of analyzing the complex tables. 

In order to illustrate Fisher's exact treat- 
ment for 2 x 2 contingency tables and the exact 
treatment of Freeman and Halton for contin- 
gency tables other than the 2 x 2, the associa- 
tion between ‘‘extra-curricular activities” and 
“taught fifth уеаг” was investigated in a small 
sample of twenty cases. This sample consist- 
ed of the Industrial Education majors for the 
1948 graduates. These data are given in Table 
ІШ. The obtained chi-square by the uncorrect- 
ed shortcut formula was 4.3, with 1 df, which 

is significant at the . 05 level. емер re 
the corrected shortcut formula was 2.1 wi , 

ich is not significant at the .05 level. These 
v leave one in something of a dilemma. If 
we далар! the results of the corrected formula, 
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we must conclude that the results are non-signif- 
icant. If we accept the results of the uncorrect- 
ed formula, we conclude that the resultsare sig- 
nificant, but with the knowledge that we have vi- 
olated the rule for minimum-sized theoretical 
Írequencies. Such a situation as this is one 
where exact methods are very applicable. 

First, we use Fisher's exact method to deter- 
mine whether the results are in fact significant 
Or not. The principle of Fisher's exacttest con- 
Sists in assuming that the marginal totals remain 
fixed, using a formula yielding the probability of 
having any set of cell frequencies, calculating 
the probabilities for the observed set of cell fre- 
quencies and all more “extreme” arrays (i.e 
arrays which would yield a chi-square of great- 
er magnitude than that for the observed array); 
and summing these probabilities. This summed 
probability gives the probability of having ob- 
tained by chance alone an array as “ехігете” 
or “more extreme" than the observed array, 
and this probability is then referred to some pre- 
determined significance level, such as the .05 
level. For example, if the obtained probability 
were more than .05, we would accept the nul 
hypothesis, and we would reject the hypothesis 
if the probability were less than .05. It woul 
be noted that this is a one-tailed test of signif- 
icance. 

Using the exact formula given previously for 
Ше two-way table, we find that the probability of 


MA Observed array as given by the data of Table 
is 


p. 109: 3' 17: 


= Жогогіг 36 -0.074 


Since no other array with the same marginal tot- 
Y has а probability smaller than or equal to 
0.074, this is in fact the probability correspond- 
ing to th 


this probability is exact, it is evident that the 


earranged into а 2 x 3con- 
egrouping of the basic cate- 
ategory of “did not teach 
was divided into two new cate 
ta are given in Table IV. 

ability of obtaining the array 
> ndom sampling alone is given 


. зата 
P = жиз” = 0.030702 
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TABLE III 
2 x 2 CONTINGENCY TASLS то TEST ASSOCIATION OF “EXTRA-CURRICULAR 
ACTIVITIES" AND TEE ATTRIBUTE, "TAUSET DURING FIFTH YEAR", 


FOR 1918 INDUSTRIAL EDUCATION MAJORS 
Extra- ы > — 
Curricular Teught During Fifth Year 
зору ква Хез 
Хез 0 3 
(0.0%) (100.0) 
Е 3 
N 11 
No (6..7) (100.0%) 
11 20 
х2 = 1.3 (without Yates! correction) 
ағ = 1 
.02« P< 05 
х2 22,1 (with Yates! correction) 
df z 1 
10< P< .20 
TABLE ТҮ 
i" qRA-CURRICULAR 


am ASSOCIATION or "EXT l 
2 x 3 CONTINGENCY TABLE 50 ATT р AME YEAR", 
ACTIVITIES" AND THE ATTRIBUTE; г 
FOR 5 Е 

ivities 


Taught During Fifth Yeer pxtra-C ч 
Yes 

11 п 

Taught fifth year (Gli. T 
n 7 

Taught, left, and have поб returned (200.08) (2305) 
б 2 d 2 

Had not taught since graduation (0.0) (Teer 
20 


17 
(100,072) 


(200.0) 
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ALL POSSIBLE ARRAYS WITH FIXED LARGINAL ТО 
GIVEN BY THE DATA OF TABLE IV 


0 X1 

3 4 

0 2 
а 

ub 10 

2 5 

0 2 
5 

2 9 

1 6 

0 2 


TABLE V 


b 
0 11 
2 
L 
e 
Я. 10 
1 6 
2. x 
h 
2 9 
0 
1 ER 


TALS AS 


0 11 

1 6 

2 0 
$ 

1 10 

0 

2 0 
i 

3 8 

0 7 

0 2 
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TABLE VI 
PROBABILITIES Fi 
ВЕ қашық а POSSIBLE ARRAYS WITH MARGINAL TOTALS AS GIVEN 
SERVED x З TABLE OP ATTAIBSULES, WEXTRA-CUARICULAR 
IvIES'" AHD "TAUGHI жатыс FINCH YEAR", FOR 
1948 INDUSTRIAL EDUCATION MAJORS 


0 3 0 11 h 2 .030 702 

0 2 1 11 5 1 +036 842 

с 0 1 2 11 6 0 .006 140 
а 1 2 0 10 5 2 „202 632 
е 1 1 1 10 6 al „135 068 
f i 8 2 10 1 0 «009 619 
g А i 0 9 6 2 „337 719 
һ " 0 1 9 1 1 „096 191 
и š " 8 1 2 «а 737 

1.000 000 


An31TBULES "их" пахрад- ООААТОМАВ 
; оғ ANTAIBULESS, gi, FOR 1918 AND 


TE 
2 - 
x 2 CONTINGENCY ТАВІ "T БІ 
qp "TAUGHT i. COMBINED 


ACPIVITIES", z 
1919 ФАРО? 
\ 
Sex 
Female 
Male 
taught. 
Taught yifth 
{ Fifth Yeer 
Year 
зі Yes No 241 382 
Xtra. 
а Уез ща. 156 yok 
ies No 298 
397 839 
256 183 439 
x = о. ШТ 
af z 1 
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The method of Freeman and Halton asks us to 
consider the probabilities of all possible arrays 
for a given set of marginal totals. Before pre- 
senting the probabilities for these arrays, it is 
well to consider the nature of the arrays them- 
Selves. The nine 2 x 3 tables given in Table V 
(a through i) represent all possible arrays with 
the marginal totals of Table IV. Array a of Ta- 
ble V is the same as the data of Table IV. Prob- 
abilities of the other eight arrays were comput- 
edinlike manner. The probabilities for the com- 
plete set of nine arrays are given in Table VI. 
There are two probabilities smaller than that of 
the observed array a, which is 0. 030702; these 
two probabilities are those for arraysc and f 
and are numerically equal to 0. 006140 and 
0.009649, respectively. When these three prob- 
abilities are summed, the total is equal 
to 0. 046491. This figure represents the proba- 
bility of having the observed array oranyarray 
more extreme. Since the obtained probability 
is less than . 05, we reject the null hypothesis 
of no association between the attributes. 
The results of the foregoing test of signif- 


been found; a 2 x 3 table was needed in order to 
uncover the relation. 

These results raise the question of thenature 
of the association. The association may be in- 
terpreted by noting the percentages in the уаг- 
ious cells of the 2 x 3 table. Among the three 
persons who had Participated in ехіга-сиггіси- 
lar activities, all (ог 100.0 percent) were found 
to have taught sometime during the first five 
years, to have left teaching and not to have re- 
turned by the fifth year. Among the зе venteen 
persons who had not participated in ехіга- cur- 
ricular activities, a relatively high percentage 
(64.7) were found to һауе taught during the fifth 
year. We may state the relationship, then, by 
saying that participants in extra-curricular ac- 
tivities tended not to teach during the fifth year, 
while non-participants tended, by and la rge, to 
teach during the fifth year. These results are 
similar to those found for all majors for the 
1948 and 1949 samples. In addition, for the In- 
dustrial Education majors it was found that par- 
icipants tended to teach for a short period, to 
jm teaching and not to return by thefifth year. 

leave is by Complex Contingency Tables— 
Busy ва tables are illustrated 
Te Sota irat 18 à 9 X 3 K 2 table illustrating 
here. Да ot Bartlett and Snedecor, while the 
ee = a tones table illustrating the li keli- 
other 
hood ratio car е the method of Bartlett 
In order to 2x2x2table, the data 
and Snedecor for the 
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were classified by the two pregraduation attri- 
butes “взех” and “extra-curricular activities, 
and by the postgraduation attribute, ‘‘taught dur- 
ing fifth year." The results of testing the asso- 
Ciation of the postgraduation attribute, **taught 
fifth year," with the pregraduation attributes, 
“Sex” and “extra-curricular activities” individ- 
ually in two-way tables had showed strong а550- 
ciation (і.е., probabilities smaller than .001) in 
every instance. It was suspected that there might 
be association among all three of the attributes 
Ог what has been called “second-order interac- 
tion" by Bartlett and Snedecor. The kind of 
Second-order interaction suspected in the pres- 
ent instance was that of a sex difference in the а5- 
Sociation between the two attributes, “ех! Dae 
curricular activities” and *'taught fifth year. 

The 2X 2 x 2 table is shown in Table VII. The 
first step in the analysis of the data was to di 
ine each of the 2 x 2 tables which were classifie 
by the two attributes, **extra-curricular activi- 
ties” and “taught fifth year, ’’ for independence. 
Thus, there were separate 2 x 2 tables for the 
two sexes, one for males, the other for females. 
The obtained Chi-square for males was 0. 447, я 
with 1 df, which is not significant at the .05 level; 
chi-square for the females was 18.665, with 1 df, 
which was Significant at the . 001 level. 

The second order interaction was calculated 


as follows: 

ай» с" 79)(121)(81)(168 

arab = (19121610460, 16 
In order to 


test the hypothesis that in the деи 
tion the Second-order interaction is unity, the va. 
ue of the deviation Їх common to all eight cells 
of the 2 x 2 x 2 table Was determined by solving 


the equation 
(a-x)(d-x)(e* -x)(b' 7X) = (e«x)(b«x) (a! +x) (d' +x) 


Substituting the cell fr 


equencies from our data; 
We obtain the equation 


(19-х)(121-х)(168-х)(82-х) - 
(624x) (1764) (734x)(154x) 
which reduc es to 


514 х? - 24,664 x2 ~ 4,318,692 x - 71,941,584 = 0 


А first approximation may be obtained by ignor- 
ШЕ the first two terms and solving the equation 


4, 318, 692x - 71, 941,584 - 0 


Solving this e quati 


p Оп, we obtainasa first 
approximation 
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_ 71, 941,5 
pas 84 16.658 


, , 


As a fi n 
which the ШЕН in finding two values of x between 
changes d t-hand member of the equation 
off to 16 = the obtained x above was rounded 
yielding ins substituted in the cubic equation, 
member ы 5,576,816 for Ше left-hand 
next lower i us second step was to substitute the 
Value 122 HD number 15 for x, yielding the 
Negative. Whe which is smaller but which isnot 
left-hand m hen 14 was substituted for x, the 
-5, 235, 336 ember yielded the negative value 
Sign, Then indicating the desired change in 
etween th efore, the value of x was known to lie 
же ошер b qnit 15. 
Solving the pes s was obtained by 


X - 14 5, 235, 336 
I 15-х ^ 122,946 
ре х= 14.9 
better а, 
er approximation was desired, and it 


5 Тоц 
я ра the left-hand member was 
r 14. 98 and was -39, 205. 44 for x 


ма. 


Е 14. 9 
T. The equation 
X-14.97 | 39,205.44 
fr =x = 14,834.76 
9m Which 
x = 14.977 
Тһе ob 


tai 

i ne 

е. р MER value of x, rounded off to two dec- 

formula f or x = 14.98, was substituted in 
or chi-square as follows: 


x? ( 
Ix] ове |. + 1 1 


“(1 
4, 98-0. 5)? ( EM Xm 1 
79-14.98 + 121-14. 98 й 


1 
sre Poe ИИ 1 1 
82-14.98 t 62:14. 98 + T1614. 98 
NE 1 
й 75114298 + 75114.98 
T 
- 48)? ( 1 1 1 1 
94.02 + 106-02 * 153.02. “67.02 
——— - 1 1 
+ 224 6.98 + 190.98 * 87.98 * 89.98 
5 400(0. 0872) 
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= 19. 568 


The obtained chi-square for the se - 
interaction is 19.568, with 1 df, mida. я реко 
icant at the .001 level. Therefore, we ерес дн 
null hypothesis of no interaction. 

Rejecting the hypothesis of no interaction 
raises the question of the nature of the interac- 
tion. А significant interaction tells us that there 
is a difference in the nature of the association 
of the other two attributes for the sexes. Тһе 
differences are such that among the males, par- 
ticipants and non-participants in extra-curricu- 
Jar activities were equally likely to have taught 
during fifth year, while among the females the 
participants in extra-curricular activities tend- 
ed not to teach during the fifth year. 

А four-Way contingency table classified by 
“year”, ‘spank’, “honors' and “extra-curric- 
ular activities" is given in Table VIII. By means 
of the likelihood ratio, five hypotheses were test- 


ed for this table. They were 


1. The four attributes, “уваг”, “гапк”, *thon- 
ors", and «extra-curricular activities” are 


mutually independent. 


tributes, “тап”, “honors”, and 


2. The three а! 
ctivities’’, are mutually 


‘extra-curricular a 

independent. 

3. The two attributes, crank” and ‘‘honors’’are 
independent. 


4, The two attributes, “тап » and ‘‘extra-cur- 
ricular activities” are independent. 


««Бопог5"" and “ех га- 


5. The two attributes, 
independent. 


curricular activities” are 


In Table VIII the letters A, B, C; and D in 
our symbol system represent the attributes in 
the following order: “уваг”, «rank, ‘‘honors”, 
ала «extra-curricular activities". 

It will be recalled that any of the likelihood 
ratio criterion formulas for е stimating chi- 
square for all possible hypotheses based upona 
four-way table could be expressed in term s of 
combinations of eighteen terms which were nat- 
ural logarithms of functions of cell or marginal 
totals. In order to test the five hypotheses for 


the present four-Way table, only twelve of the 
equired. The twelve 


eighteen terms were г 
terms, along with the calculated numerical 
values are shown on the next page. 

The required frequency totals for the twelve 
terms Were obtained by summing frequencies ac- 
cording to the indicated process. For example, 
the totals denoted пі...» which represent the to- 
tal frequencies for the years 1948 and 1949, 
were obtained by adding all cell frequencies for 
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TABLE VIII 


COMPLEX CONPIHGSNCY TABLE CLASSIFIZO BY зни ALTRIBUTES, "Yar", 
"HANK", "HONORS" AND. "EXTRA-CURRI СІЛЬ 2 ACTIVITIES" FOR 
GRADUATES ОР 1948 AND 1919 


Нопога 
Уез По 
Ехіга- Охъга- 
Curricular Curricular 
Year Rank 
Yes No Yes No 
High | 13 6 |19 
1948 Medium | 10 5 |15 
Low 3 L/h 
26 12 38 98 98 196 231. 
High 26 17 |І 28 31 | 59 
1949  Xedium 13 12 |25 ho 60 |117 
Low 6 5 Ил 15 51 | 96 
45 34 79 122 150 272 351 
В к. 117 468 
EET das BEE 
180 
оо... E 585 
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P 


= 
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1) log Tin; 
е In. - 2.3025 і 
[ni 8 Е Biss logy Mi... = 3332. 67612 
( 2) 15 п. j.. 
ge Inr = 2.30258 ° 
Па, ).. y". j.. 108100. ј.. = 3090. 81427 
( 3) 10 
Б, = 
е 2.30258 Та к 1081001, = 3434. 65550 
(4) 10 
g, = 
e 2. 30258 Еп n logygn...h = 3321.90198 
( 5) lo ij 
II ++ = ss 
Єв ig УКВ 2.30258 жұмды 10819hijkh = 2030. 79971 
(9) 10 nij 
Бе Шак. = 2.30258 ü nik, 10810044. - 2429.38732 
(13) 1 n, jk. 
о қ - 
бе і n ik. = 2.30258 i пк 108108. к. = 2820. 43333 
(14) n.j.h 
loge i n joh = 2.30258 Ë nih 10810, j. h - 2687.88973 
(15) n,. kh 
lo TI ^. = = 
Se Шпік 2. 30258 Дака logjgh.kn ^ 3032. 68764 
(16) йө п.... 
Be n... = (2.30258)(п ... 1906101...) = 3727. 39025 
ара Осы 
(17) 16 an... 
Ge п: = (2,30258)(2n, 1081 оп...) = 7454. 18051 
(18) 1 ЗА us 
ge n '' =  (2.30258)3n 108101, |,,) - 11,182.17076 


1948 
1940 S раг 
949. T А then all cell frequencies for 
mation process symbolically i$ 
Я uts 
1.347 ij 
uk H Pijkh 


and с) 
fig, ounce 1 

i eT 9f the x has been taken arbitrarilyas the 
Мощ Íor 1948 | "eene for “year”, so that 
d p, 348, the total symbolically for 1948 


5 
Znijkh 
i 


n, 


и 
mt 
хме 


Thi 
1945 expressi 
Bore ша нет tells us to add all Ше cells for 
le i or Fa Sal а viz., tosum the cate- 
bra Та-сцгтїсш first, then **honors", then 
e SS Was ан я activities". Тһе numerical 
аф, Added ac Ollows: First, cell frequencies 
the 2 the се, Ше “rank” categories, so 
rst Column left-hand 3 x 2 table we add for 
ч, = 3 
о = 
j Ча = Пиш + Поп + зи 7 


13 + 10 + 3 = 26 


maining totals for 1948 were added. 
re numerically equal to 12, 98 and 
he totals for extra-curricu- 
ummed across the categor-" 


The three re 
These totals à 
98, respectively. T 
lar activities were S 
ies of honors as follows: 


2 
и. 8 = nih 


The two totals for *textra-curricular activities" 


were 


ni, 


КГ 26 + 98 - 124 
Ni..2 1 


2 + 98 = 110 


When these totals are summed across the two 
categories of “extra-curricular activities", we 


obtain the total frequency for 1948 


2 
ПРИ Dm. 124 + 110 = 234 


The totals needed for the remaining eleven terms 
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were obtained in similar fashion. 

The twelve terms were calculated by using 
the summation form of the formula, by substi- 
tuting logarithms to the base 10 initially, then 
changing to the base e by multiplying by the con- 
stante = 2.30258. For example, term (1) was 
calculated numerically as follows: 


as 
loge Inj..." = 2.30258 Tn. 1061014... 
1 


= 2.30258 [(234)(2. 36922) + (351)(2. 544077] 
= (2. 30258) (1447. 36605) 
= 3332. 67612 


In order to test Ше first hypothesis, that the 
four attributes are independent, we use the form- 
ша of the first kind of hypothesis for a fou 
table. The expression for the likelihood criter- 
ion in terms of sums and differences of certain 
of the eighteen terms is as follows: 


r-way 


loge > = (1) + (2) + (3) + (4) - (18) - (5) 


Substituting the numerical 


values of the terms 
we have 


loge > = 3,332.67612 + 3,090.81427 + 3,434.65550 


* 3,321.90198 - 11,182.17076 - 2,030.79971 
- -32.92260 


Using the formula for estimati 


ng chi-square in 
terms of №, we have 


X? = -2 loge А 


(-2)(-32. 92260) 
= 65. 84520 


where Ше degrees of freedom is computed as fol- 
lows: 


df = rstu - (r +s +t+u)+3 
= (2)(3)(2)(2) - (2 +3 +2 +2) +3 
=18 


i i-square for the first hypothesis, 
Ди а x seni 18 df, is significant at the 
7 poi | Therefore, we reject the null hypoth- 
esis. ond hypothesis, that 
to test the sec hype л 
P Үз attributes ‘‘rank’’, ‘ hona avd 
ЕЕ, urricular activities” are нн ЕЧ inge- 
и we use а formula of the second type. 
pend ikelihood ratio criterion iS 
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loge > = (2) + (3) + (4) - (17) - (9) 


Substituting the numerical values of the five terms; 
we have 


loge à = 3,090.81427 + 3,434.65550 + 3,321.90198 
- 7,454. 18051 - 2,429. 38732 


-36. 79608 


from which 


X* = 73.59216 


The df is given by 
df = rstu -(s + t + u) -2 
=" 

The obtained chi-square for Ше second hypo ня 
esis, that is, 73.592, with Т df, is = quen И 
the .001 level. Therefore, we rejectthe nu 
pothesis. | " 

In order to test the third, fourth and fifth hy 
potheses, formulas of the third type were us hi 
The appropriate formulas for an estimate rem 
Square to test the third hypothesis, that ' E өй 
and “Әопогв” are independent, is expresse 


terms of sums and differences of the eighteen 
terms as follows: 


loge > = 3,090.81427 + 3,424.65550 - 3,727.39029 


-2,820. 43333 
- -22.35381 
from which 
X* = 44.70762 


The df is given by 


df - (s - 1)(t - 1) 
2 


The obtained chi-square for the third hypothesis: 
that is, 44.70 


8, with 2 df, is significant at ie 
001 level. Therefore, we reject the null hypo 
esis. 

„Тһе appropriate formula for an estimate of 
Chi-square to test the fourth hypothesis, that 
“rank” and “extra-curricular activities” arein- 
dependent, is expressed in terms of certain ОЁ 
the eighteen terms as follows: 


loge > = (2) + (4) - (16) - (14) 


Substituting the num 


erical values of the four 
terms, we obtain 


loge > = 3,090.81427 + 3,321. 90198 - 3,727.39025 
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- 2, 687. 88973 
= -2. 56373 
from which 
X? = 5.12146 


The df is given by 


df = (r - 1)(u - 1) 
2 


Тһе obtai 

esis, ped chi-square for the fourth hypoth- 

Cant at the s, 5.127, with 2 df, is not signifi- 

ject the .05 level. Therefore, we do not re- 

The = hypothesis. 

неса е formula for an estimate of 

ors” ang е to test the fifth hypothesis, that ‘‘hon- 

dependent extra-curricular activities” are in- 
, is expressed in terms of sums and 


differ 
enc Е 
Ollows: es of certain of the eighteen terms 5 


lo 
Ве > = (3) + (4) - (16) - (15) 


Subst 
itutin, 
terms, oe values of the four 


log, 
ex = 3 
,434.65550 + 3,321.90198 - 3,727.39025 


-3, 032. 68764 
А = -3. 52041 
rom which 
X? = 1.04082 


The ағ; 
af is given by 


df 


(t - 1)(u - 1) 
1 


he 
t Obtain i 
that is, 7, eee for the fifth hypothesis, 
ені level. Th. with 1 df, is significant at the 
З» егеѓоге, we reject the null nypoth- 


Anal. š 
9 ys 
ws of Yates Scoring Techniques ее meth- 
елі a 3x 3 со s Williams were illustrated 
upon rable а” көрпе table. Thedata are giv- 
ang Ве three Here the classification is разей 
с d attributes, “тапк”, ««honorS", 
io, Зо mas ar activities". The like li- 
ficat among ee had shown mutual assoc i- 
АНОД of rows ir three attributes. The classi- 
Dk" ana ms in Table IX is by categories 0 
“е ation e classification of columns is by? 
Та-сиг 9f Ше categories of “honors”? and 
м. que но анаан ав, 
ах ее IX was 
df, which is significant at the 
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-001 level. Therefore, we reject the null hypoth- 
esis of independence of the classifications. Since 
this is a contingency table in which association 15 
known to exist, the methods of Yates and Williams 
are applicable. Especially is this true since 
there appears to be a kind of departure in the ta- 
ble which resembles the arrangement of frequen- 
cies ша scatterdiagram in which positive corre- 
lation exists. For example, in the first column 
of Table IX there is a tendency for the cases to 
‘pile ор” in the lower left-hand corner (34.3 рег- 
cent) аз compared with those in the upper left- 
hand corner (20. 6 percent), while in the third col- 
umn there is à tendency for the cases to “pile 

” in the upper right-hand corner (55.0 percent) 
as compared with those in the lower right-hand 
corner (12.7 percent). In the methods of Yates 
or of Williams, We test whether the association 
between row and column scores 18 5 ignificant, 
where the scores are assigned on the assumption 
of an underlying quantitative basis. 

The Yates solution follows the representation 
in Figure 1. The numerical scoring scheme for 
rows and columns and the summation terms 
which were с 
are given in Table X. T 
columns were chosen arbitrarily. 
ient in the present data to make the score for the 
middle category of the rows and columns eac h 
equal to zero, in order to simplify the calcula- 
tions. 

The three quantities, А, А" апа В, needed 
for the regression formulas were calculatedfrom 


the summation terms as follows: 


A за. Z xin, (2 хуп)" 


= 585(350) - (-10)? 
- 204, 650 


№ =n. ДУРА ЗУ У ђ* 


= 585(319) - (тт)? 
- 155,286 
в -n.7 (qr ура 3 (Gan, 0 yn) 


= 585(64) - (-10)(-177) 
= 35,670 


The two regression coefficients were calcu- 


lated as follows: 
byy = B/A 
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TABLE IX 


CONTINGENCY TABLE TO TEST ASSOCIATION BETWEEN "RANK" 
AND CONBINATIONS OF "HONORS" AND 
"EXTRA-CURRICULAR ACTIVITIES" 


Combinations of Honors and Extra-Curricular Activities 


Both "no honors Either "honors" 

and "no extra- and "no ехіга- 
Rank curricular" curricular" ог 
"no honors" and 
"extra-curricular" 


Both "honors" 
and "extra. 
curricular" 


51 8о 39 
High (20:67 (30.0%) (55205) 
112 100 2 
Mediun (45.2%) (37.64) (32.49) 
Low 


85 86 
(31,32) (32.34) (12.24) 


(100) (99:950 (100724) 
x? = 344436 
af = ц 
P< .001 
TABLE X 
SCORING SCHEME AND sUMMATION TERMS IN YATES! 
SOLUTION OF DATA IN TABLE ІХ 
27 1 0 x 
y j -1 0 +1 
x 71233 
-12 
-89 
-76 


Fm, = 20 оза): ву 
È ууа, у = -177 r (фа) = 350 
x (уда, 3) Е 319 


170 


235 


180 


585 
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35, 670 Williams’ method provides empirically-derived 
- scores which yield Ше maximum value of the cor- 
relation coefficient which would be poss iblefor 
- 0.17430 any set of scores for the same data. The Willi- 
-— ams' solution follows the scheme given previous- 
byx - B/A' ly in this paper. 
Starting with the original data in TableIX, the 
_ 35, 610 matrix С was computed by Ше formula for Ше е!- 
= 155,286 ements as follows: 
= 0.22971 gij = ni/ ni. n, j 


E Standard errors of the regression coef- 
S were calculated as follows: 


ВЕ. of byy = VAAR., 


155, 286 
204, 650(585) 


fic 


- 0.03601 
and 
S.E. of byg = V A/A'n,. 


_ 204,650 
155, 286 (585) 


T - 0.04746 

һе пори: 

Петел салсе of each of the regression coef- 

he ooi. tested by means of the t test, where 

tion regr esis in each case was that the popula- 

et fus coefficient was equal to zero. 
for the b's were performedas follows: 


8: _ 0.11430 _ 
қығы "отап "599 
ЖЕГЕ = Зы = 4.840 


Rete 
rri 
We fin ing the obtained Рв to the normal tables, 


{ы e Р<.001. Therefore, we reject the 
ща Populate, We conclude, therefore, that 
“dual to care regression coefficients are not 


Ш 
с 
Я 


7 t? - (4. 840)? 
- 23.426 
%і-і 
P«.001 


ere 
Score е the association of row and column 
ще Ве oe to be significant. , 
оа № апа column scores used іп the Yates 
SY wer еге arbitrary, and we do not know that 
е the most appropriate for the data. The 


For example, the element of matrix С in the first 
row and first column was computed as follows: 


Ват 2nji/Yn,.n,.; 


= 51// (110)(248) 
= .24838 
The matrix G is 
. 24838 . 37621 . 35500 
С = . 46394 . 39997 . 17806 
. 40231 . 39304 . 07961 


Тһе matrix T was obtained by T= СС" 
and numerically the calculations were as given 
at the top of the next page. 

In order to calculate the scores for rows and 
columns which would maximize the correlation 
between the two sets of scores, it was necessary, 
or the second largest latent root 


first, to solve f 
> of the matrix T. From T we have the determ- 


inant 


.329 2516 -> .328 9174 . 276 0529 
.328 9174 .406 9217-2 .358 0273 
„216 0529 .358 0273 .322 6715 -à 


which when expanded yields the characteristic 
equation 


хз - 1.0588 32 - 0.0589 à = 0 


From Williams (12) we know that the largest 

root of the characteristic equation is unity, that 
the smallest root is zero, and that the remain- 
ing root, which we desire here, lies somewhere 
between zero and unity. Solving the cubic equa- 
tion by the method previously given, we find that 


the desired root 
>x = 0.0589 
s root gives Ше square of the 


elation between the variates as- 
ow and column scores. 


The value of thi 
maximized corr 
sumed 10 underlie the г 


The correlation coefficient 
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. 37621 
. 39997 
. 39304 


.24838 . 35500 
T= . 46394 . 17806 
‚40231 „01961 


.328 9174 š 
- 406 9217 . 
.258 0273 # 


. 328 9174 


. 329 2516 
.276 0529 


гху = УХ = 0.0589 = . 24 
'The scores for rows oí the contingency table 


were calculated by first solving for a set of so- 
lutions bi to the set of simultaneous equations 


[T-I] {bi} =0 


and then finding a set of scores proportional to 
the bj’s so as to satisfy the restrictions 


20.4: = 0 
& 

„йй = 
Enix =R 


To solve for the bj’s we first subtract \=0.0589 


from the three main diagonal terms of the ma- 
trix T as follows: 


.3293-.0589 .3289 . 2761 

Т-М ={.3289 .4069-.0589 . 3580 
2761 .3580 .3221-.0589 

. 2704 . 3289 . 2761 

=|. 3289 . 3480 . 3580 

. 2761 . 3580 . 2638 


Using the elements of the matrix T - ХІ as co- 
efficients, we write the system of simultaneous 
linear equations 


. 2704 b, + . 3289 b; + .2761 b, = 0 
.3289 b, + . 3480 b; + . 3580 b, = 0 
. 2761 0, + . 3580 b; + . 2630 b, = 0 


Solving Ше equations, we obtain Ше values of 
the bi's 


b,- 3.731 
ba = -1. 000 
b, = -2. 218 


{* re transformed to а setof row 
Lane ша | ав бй satisfy the restrictions given 
amic The first step in this transfor ma - 
idm 5 that of expressing the three row scores 
i iy rms of опе of the row scores. The score 
An preis row, Ха, is the easiest score com- 
piis ally to deal with, for since we must ob- 
pua of xi's proportional to Ше bi’s, we may 
tain 


. 24838 . 46394 40231 
. 37621 . 39996 39304 
. 35500 .17806 07961 


276 0529 
358 0273 
322 6715 


express Ше three row scores in terms of x; as 
follows: 


X, - -3.731 x; 
Ха = X2 
Хз = 2.218 x; 


Substituting the values for the xj’s in terms of X2 
in the second restriction equation, we have 


Znjxf = 170(-3.731)?x2 + 235 x2 + 180(2. 218)? 
: хі = 585 


from which 


X2 = 


Checking to see that the obtained x;’s satisfy the 
two restrictions, we have 


Znj, хі = 170(1. 528) + 235(-0. 410) + 180(-0. 909) 
š = -0.210 


and Zni.x; - 170(1.528)? + 235(-0. 410)? 
1 + 180(-0.909)? = 585. 148 
and conclude that both restrictions are satisfied 
with negligible error. 
The scores for columns of the contingency ta- 
ble were calculated as follows: 


51(1. 528) + 112(-0. 410) + 85(-0. 909) 
= -0.768 

80(1.528) + 100(-0. 410) + 86(-0. 909) 
^ С — — 

= 0.049 

39(1. 528) + 23(-0. 410) + 9(-0. 909) 


= 2.489 


Checking to determi: 
fy the two restrictio 


Ул, 
1 


ne if the obtained урз satis- 
nS, we have 


jYj = 248(-0. 768) + 266(0. 049) + 71(2. 489) = 
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= -0.711 


and En cy. = 
те, jt 248(-0. 768)? + 266(0. 049)? + 
71(2. 489)? = 585.6 


and со 

with EN that both restrictions are satisfied 
P egligible error. 

row 5. on the accuracy of the obtained 

ical а rire xj and column scores yj, thenumer- 

formula о scores were substituted inthe 

Cient as ee correlation coeffi- 


г = 
xy = 2 nijxiyj/n.. 


= [51(1. 528)(-0. 168 
-0. 168) + 80(1. 528)(0. 049 
+ И праг а. ава + 11240; о 168) 
А и. 049) + 23(-0. 410)(2. 489) 
-0. 909)(-0. 768) + 86(-0. 909)(0. 049 
+ 9(0. 909)(2. 489)] 7585 ^ Jess 


Which ch | 
expression with the value of rxy found by the 
= x 


Гху Е 


The signif; 
ед as ime of the correlation was test- 


xX? = 
n, r&y = 585(. 24) 
= 33. 696 

ағ = 1 

Р<.001 


Пегер 
Significant we conclude that the correlation 15 
lams, e the .001 level. According to Wil- 
Dlest ir po e interpretation of the data is sim- 
Ëstactorily association can be accounted for sat- 
angle Daie in terms of the correlation between 
attributes ‚ОЕ variates corresponding to the two 
(tribute thew ОВР бап readily imagine how the 

: Such засе. might have an underlying уагі- 
dily кыы e for the other attribute is not 
le. Ó nceived, although it is not incon- 
ig Aure of ы can only speculate as to the actu- 
во 9f the рг e underlying variates, On the bas- 
ча, lation resent data. We сап interpret the as- 
boss tende s such that “10977? ranking grad- 
“ie not to be honor students and/or 10 
te 


а 
езү, 
aj ab 


Partici 
hile, кыо in extra-curricular activities 
р as Sieg ee “high” ranking graduates 
“rticipant to be honor students and/or 10 be 
S in extra-curricular activities. 


Su 
mm 
а 
Ty and Implications 
Thi 
п 18 
цу бег tm has described and illustrated 
ing ан statistical techniques for апа- 
ciation of attributes in с ontingency 
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tables. Among the techniques are (1) those 
which permit the testing of hypotheses about re- 
gression and correlation of assumed underlying 
variates іп г х 5 tables in which association is 
known to exist; (2) those which permit the test- 
ing of hypotheses involving three or four attri- 
butes simultaneously in an г xsxtxucontin- 
gency table; and (3) exact tests of significance 
for small sample data in r X s and r X s X t con- 
tingency tables. 

The illustrative data were taken from ап inves- 
tigation of the postgraduate experiences of two 
graduating classes from a large teacher- train- 
ing institution. Attributes of the graduates con- 
sisted of two main kinds: (1) pregraduation at- 
tributes, or those known at time of graduation, 
and (2) postgraduation attributes, or those char- 
acterizing the first five years of teaching exper- 


iences after graduation. 

The statistical techniques presented hereare 
applicable to many educational problems where 
they are not now being utilized extensively. In 
the first place, there are the instances where 
frequencies are often reported along with the cor- 
responding percentages but without tests of sig- 
nificance, although generalizations are made 
from the data. Secondly, the availability of 
such techniques should suggest the use of previ- 


d categorical data. Itis recommend- 


ously ignore 
ed that such enumerative data augment rather 


than supplant continuous data. The techniques 
ata from surveys andto 
biographical data. Lastly, much data in the be- 
havioral sciences are of such a nature that they 
are not immediately quant 
mean, however, that they are inherently incap- 
able of quantification. Often, our operation up- 
on the data are of a primitive sort because of the 
immaturity of the science itself. Itisto be hoped 
that techniques of contingency table analysis will 
assist in quantifying qualitative data. 
It is also to be hoped that the techniques pre- 
ill be given the widest possible dis- 


sented here Wl 
semination and application to appropriate pr ob- 


lems. 
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THE BEST LINEAR ESTIMATE OF THE PRE- 
DICTED VALUE AND THE STANDARD 
ERROR OF THE ESTIMATE 


PALMER O. JOHNSON 
University of Minnesota 


ао ius AND NEYMAN* used the Markoff The- 
problem erem a general method for solving the 
а criterion obtaining the best linear estimate of 
mate. Th and the standard error of the esti- 
Cation of са gave as an illustration of the appli- 
ent and оп е theorem the case of one independ- 
or this i dependent variable, say X and Y. 
tions Sane oe there is little difficulty in calcula- 
арена raw scores. For more than one 
ever, wes variable, say Xi, Хг,:::› Хз, POW- 
Save mon NEUE the use of deviation scores to 
for the owe work in deriving formulas 
18 to obtain em we consider here. Our purpose 
» from a die general form for the estimation of 
ent variabl ixed set of more than one independ- 
е determin 146% from X,, Х»,... ‚Хэ, апа 
ап mine ня of the standard error of such 
Th З 
ferentiat, pd d situations that need to be dif- 
ей with respect to the predicted value: 
1; . 
Say, moe estimate of the true mean Y-SCOr €; 
of al ace of all predicted y's, or E ($)'5, 
fixed, ае in the population who have 
x 4. The Е values of X,, Ха)... ‚Хэ. 
У Score е Y score for any single рге 


dicted 


It is ві қ 
е айап (1) with which this paper deals. 
uas useg Summerize the notations and form- 
Change by David and Neyman. Several 
ум S Were made to fit our problem in gen- 


ings, "ош distracting from the original mean- 
үзіле, 
Xu s um Y score of the ith individual 
‚ score of the ith individual 
(1) 
- 


= th 
h € Xs score of the ith individual 
en ns 
1, 2,... n; n denotes the number of in- 
Эр 
` N 
Ме“ Davie 
Wir: 4 and J, Ne т і f thi 
S e Neyman. Extension o. e 
Ss, IT (December 1938), рр» 105-106. 


Markoff Theorem on 


dividuals. Assume also that X,, X2,---,%gare 
independent variables and that the relationship be- 


tween Y and each X is linear. 
Define again, | 
x; Xi -X, (2) 


When yi, Xib Хгі»::?: „Ха are deviation scores 
of Y, Хі» Xs ‚Хэ, respectively, for the ith 
individual, Y, %,, Х.,:--„Хв аге mean scores 
of Y, Хі» X» ‚Хз, respectively. With these 
conditions, we may write ўі = ЕА) = а11р:+.;:+ 


aisPs + 2i(st) Р(5+1) (3) 
Where $i or E(¥j) denotes the mathematical 


expectation of yi; pi and Ps are to be considered 
as unknown parameters. For our special case, 


aii -1 
анын (4) 
ais = Хв-1 


а (в+:) = Х5 
Markoff Theorem, We obtain ў; = 


Ву using the 
зх. 128 

EG)- ZW (5) 
2 AA di 


нў = 5-0 А? 


quare of the standard er- 


when "s, denotes the 5 


ror for the estimate of each individual; ndenotes 
the number of individuals involved, s is the num- 
ber of independent variables. Theterms А, Ау, 


Ap and A , are the determinants as indicated 


on the next page. 


Least Squares," statistical Research 


234 


JOURNAL OF EXPERIMENTAL EDUCATION 


Gi, 


Gar 


Св: 


G(s+1)ı 


n 
where Сук = й, рі ара 


For our problem, 


where 


n 
Hj = 5 pi yi ij 
J i-i 


For our problem, 


різі 
0 
H, 
H; 
Hs 
Н(5+1) 
b, 1 
b; =X, 
b; х, 
bs = X(s-1) 
b(s41) = Хв 
рі = 1 


бш дана. а 
б наи фа 
без wae Ga 


(5+1). .... G(s.1)s 


b, Du диван 
G, 1 G, B зеззу 
С, Сва —— i 
Gs, б... 
Sa) (5+1). ..... 


Gi (s+) 

Сг(в+1) 

Gs(s+1) 

G(s+1)(s41) 

bs b(s41) 
Gis Gi(s+1) 
Ges бг (5+1) 
Gss Gs(s.1) 


6(5+1 (8+1) G(s+iXs+i) 
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(7) 


(8) 


(9) 


(10) 


(11) 


(12) 


(13) 


— 
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Ho H, He vd Hs Н(5+1) 
H, С. Сі: 4... Gis С, (5+1) 
H; Gar G22 IT Ges бын 


ща | (14) 


0 
Hs Gs, Свг ася: Gss Gs(s+1) 
Н(в+:) G(s+i)i G(s+1)2 G(s«1i)s G(s41Xs+1) 
Where H, = 
AE аз a 
Е 
Or our Problem, pi = 1 аб 
All the other notati кке "- 
otations are the same as indicated in (7) an (10). 
0 b, b; bs b(s+1) 
b, Gi Giz Gis Gi(s+1) 
b; Gar G22 Gos С2(8+1) 
A я (17) 
‚= 
G Gs(s+1) 
bs Св: Gs(2) 55 
с G(s+iXs+1) 
b(s+1) Св): G(s+i)z 7 (6+1)8 (s+1X 
Wher 
ean 
B the notati зааноачед iñ (l) and (10). | | | 
Writing ¢ ions are the same as indica TY ДД formulas which will be useful in 
чы ee Start to work out our problem, we give some elementary 
Solution in more general form: 
i 3 т -Тъг. зГгу. з 
г. нн riy-TioT2y — iy.3 y 
à = ра i тт s Муз 
lg Tis У1-т?; Tiy.2 FEE Лу 12.3 зу.з 
Mags 
IST | а-г, (1-22, з) 1-Ву = (1-г2у)1-г2у.л) (18) 
"аз = 2 
(Lrg y)(1-r8y.4)(1-r3y.s2) 
2 2 2 ob. = oy(1-riy) 
ов = 9501-13) ry = о-в аз) 
o.a = 61(1-Ві.23 y y. 


OF. 123 og -R$. 123) 
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where 1, 2, 3 denotes x) ‚ X5, Хз. 


(Vol. 25 


Now we consider the estimate of Y from only one variable X. Ву (1), (2), (8), (11), and (15), we have: 


Gi, = n, Gi; = Gz, = Ex = 0,= Gz22= Ух? = поё 


b, =1, b, =x 


Ho = Zy? = по, H, = Ху = 0, Н,- Zxy- пгхудхоу 


From (7), (10), (14), and (17), we һауе 


(1-r2,) 


n 0 

А = = поё 
0 поё 
0 1 x 

А, = 0 по = -п'гохоух 
пгохоу 0 поз 
noy 0 пгохоу 

А 0- 0 п 0 = подо 
nroygy 0 пох 
0 1 x 

VAR 1 за 

1 п 0 = -п(оу+х ) 
х 0 пох 
From (5) we obtain: $^ гху су x 
Ox 


If we want to estimate Y from X we simply use definition (2) and easily get 


From (6) we obtain* 


uy = oy (1-rxy) [ * EX or нута 


2 
n-2 9x 


( 


+ (X-X)? 
оў 


| 


Next we consider the estimate of Y from two independent variables X, and X, 


. " s + + 2 
t statistical knowledge it is not difficult to show that ys 
ж By pyra aluate the standard error of estimate for Y score. pn 


be us 
in this papere 


2 
This НА. КЕ 
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Hence this formula CA? 56 


hen similar situation? 


(19) 


(20) 


(21) 


(22) 


(23) 


(24) 


(248) 


(25) 
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жж 
Following the same procedures, we have 


n 0 0 : (26) 
^ е ES = noto? (1-тлг) 
Š пої 
2 
0 пг,г002 102 
0 1 Xi Ха 
5 д ð 0 _ “noua Гев (pay-pa tay) да ray mari] 
A, = з 6 (27) 
ПГу010у Or пол мате 
с? 
пг2уб:0у 0 nr,20,02 NO2 
no? 0 пг,у0:0у neay anay 
y 2 г2 -rf жЙғатаугау) (28) 
о = 
Mr,y0 dy 0 по? nr 20102 


2 
по 
пгаубабу 0 | ПГігбіба NV? 


0 1 хі та х (29) | 
2 2 x2 - 27120102X1 г} 
0 š (1-г? )«02x; +01 2 
A. з З “mae 
1 = 
x, 0 noi unge 
2 
ха 0 nr 420102 no2 


| ing formulas іп (18): 

obtain, by using 

Substitut До, So and A, into (5) and (6), we i 
uting the values of A, Дб» ^o 


x. 
У З Гіу.а 0у.2 X, +Ггу,› — j^ 


(30) 
01.2 "ке 
буз -Х.) 
су (X2-22 
„_ = Ай + Гау.2 Tai 
Org-yeriyo go 2 (х, adii Ха)? (х.-Х.)(Ха-Ха) || 
2 Х.-Х2 Е о 
X (Ke -2r 0,02 
à "TN 1 [ea eg 12 1 (31) 
Не = Y У 1+ Те. ! 


-Ж,)(Х„-Х) 
x Е Е 
xy, Sem _ Biss “бұ Фа 
or ц? - у» 1 + Beas gia 
F(y) ^ 13 
5 X,, Хә, Хз. 
P t variables 1» 
hen we consider the estimate of Y from three independen iting г and о, This 
го» Xs in WT Ë 
ЕТІ to denote Х1» хо» ХЭ E 
т аз simplicity, we use subscripts 1, 2» 2 


ughout the papers 
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Following the method used before, we have 


А 


Ш 


п 0 


2 
0 пот 


0 


nT,20,02 


2 
0 пг,20,0: по; 


0 nry30,03 ПГ230203 


0 1 X, 


0 n O0 


пгу010у 0 no? 


пггу020у 0 пг,0,0; 


пГзубзбу 0 пгіз010; 


0 
ПГіз0103 
ПГ230203 


nog 


X2 

0 

NY 120,02 
no? 


ПГ230203 


= ва а 2 
= п*010203 [1-r&-r&-r£s2rizrira] 


Хз 

0 
n7,50,05 
NY 230203 


поё 


0203X; (riy(l-r&) -Ггу ла-ГазГоз) * Гзу(Гіз-Гга)) 


+ 010зх, { Тгу(1-гіз) з гіу(Гіз-ГізГез) - Гзу(Ггз -T,2ris)] 


%010:х34 гзу(1-г%) x гіу(Гіз-ГігГаз) “ Ггу(Газ-ГіаГіз)) 


= -п'д 0203 

2 
поу 0 NT; ус: бу 
0 n 0 


пгууоуоу 0 по? 


ПГ2у020у 0 пг,:0,0; 


пГзубзбу 0  rg0,0; 


58-222 


<п? 0202020, 
0 1 
1 п 
x, 0 
x; 0 


x, 0 


2 


- г1у(1-г2,) - riy (1-гі;)- r$y (1-г2,) 


ПГаубабу | ПГзудзду 
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ПГ230203 


0 
NY 130,03 
ПГ 23 0203 
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+ 2гіуГгу(Гіг-Гізгаз) + 2гіугзу(Гіз-гіга) 


Ф 2гаугау(газ -Гл2Газ) 


Хз 
0 


NL 430,03 


2 2 2 
y (1-ri2 ris -r23 + Газ Газ) 
X; X2 
0 0 
2 

пої nr; 20102 

2 
ПГ |20102 no; 


DnI,5,0,03 || Dl230205 


NT 230203 
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поз 
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Айе 
г more troublesome algebraic manipulations, We obtain: 


с 
w= y-23 Оу. Oy.12 
y Tiy.23 Tis + Yay, 13 әш Хо +Гзу.12 = та Хз 
(36) 
or У=У+ гу. rim (X; -X,) + Tay. 1з Wo acte + Гзу. 12 = (K,-X;) 
y- y У 03.12 
2 2 
BE = o$(1-Ry.i23) io 1 1-ros (x, -X)* 1-гіз (Ха Ха)? 
n- Е Е Es да аз Газ of 08 
2 
+ im (X, -X))* 
03 
= таста! (х,-Х,)(Х„-Х») 
0102 
.HEucura) ск ХО В) 
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ia 02 Оз 
x x (37) 
ог 97, 123 х ШЕ 2 (X жү (Хз- х.) К (к,Х./к.-Х.) 
У па 23 eu nr i Au 04.12 тз 01.22 92-13 
(к) Qu газ. (х -Х.) 6-3) 
= 2Гіз.2 01.23 03.12 і 02.13 03.12 
rom А . 
al E i 1 form as follows: 
He above, we can finally derive the formulas for $ and ру in genera 
ES = 38) 
ма. oy. jk x,-Xj ( 
ыйы... "iy die -- M й idit 
JSE... idc 
E.g (ху X0 сю) 
By = Оу.12з...5 (x -Xi)° гії 5 
"ат „йа идым. dili jkl... Й (39) 
БЕ 
gu. for г: i<j, kae s 
ілік... for о:}<Е 
Whey 
Маца hen d " gp 121, Ber s; n denotes the number of indi- 
ssp Бела бе Бен ‘viables. 
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THE “EQUATING” OF NON-PARALLEL TESTS' 


WILLIAM H. ANGOFF 
Educational Testing Service 
Princeton, New Jersey 


method of treating the data. The various meth- 
ods of equating are not equally reliable. 

In the problem of equivalent scores that are 
derived from parallel forms of a test, there is 
by definition 2 unique “true” line. Errors ге- 
sulting from the unreliability of tests, from the 
sampling of people, and from design and meth- 
od will only ре random errors. The problem of 
«comparable" scores, on the other hand, that 
is, of converting scores from different tests, is 
more complex. Here, the psychological func- 
tions measured are different, SO that the prob- 


lem 15 not simply one of transforming units. 


To use the physical analogy again: the problem 
essentially calls for а conversion from height 


to weight. However, the statement of this prob- 
i emise, that 


lem rests on an inappropriate pr 
there is à single conversion system —and this is 
obviously not true. While it is certainly true 
that one can predict or estimate by reg ression 
equations the most likely weight of an individual 
height, ог predict scores on the SAT 


THE 
CE ee of this paper is to explore the 
ble for Ж establishing a unique conversion 
9ne test to e purpose of translating scores on 
PSychologi scores on another test of. different 
lem А pe Q function. In particular, this prob- 
astic [X ала with referencetothe Scho- 
erred to he е Test of the College Board, Te- 
Ouneil on en as the SAT, and the American 
Teferred to h ucation Psychological Examination, 
is papera as the ACE. Thefirst portion 
ОЕ error in will attempt to define the sources 
conclusions reg: a table, and will draw some 
fable of а us their implications for а 
| О eren. tut scoren. The second рог- 
| Баты с sent some empirical evidence Te 


ng s ves: 
i, Ome ditfeulties Ві setting up such a 


In dis 
cussi : 
tabl ussing the implications 04 developing 


ев of co 
Ë e to ul l. scores, it will be profit- 
ton-parallel L e distinction between parallel and 
о ests. In the conversion of Scores 


m оп 
ET e for 
ч Опе form ке to a parallel form of a test, such of a given i 
le the ЗАТ to the ACE to another, oroneform from knowledge of scores on the ACE, itisclear 
iem of transforming the Systen simply ше вас itinerant teme Fur- 
w е system 0 units. In suc 51 . - 
analogous to үзі consider the problem as directly thermore, just as in the case of regression lines, 
imet e problem of conve rsion from conversion lines which purport to translate 
өне, "aqa inches, from Centigrade to Fahr- scores across tests of different function will, in 
а Kind pounds to grams, etc. Since the fact, differ systematically, that is, they will dif- 
identical tunetana th in each case involve fer in a predic ple fashion, depending on сег- 
- M. the system of conversion 15 tain crucial considerations. Some of these con- 
veroton, On d one and only one con version siderations can be outlined as follows: 
matter Scores y oed the oe ier 1. Different lines will result when the meth- 
ве invo Here the problems include 1056 that odological definitions of comparability are dif- 
sores ona in setting up a table of equivalent ferent; and such definitions must in any instance 
+ ез + ч я ч ха: ; 
ot en include ^n of identical function, and in ad- be pur ely arbitrary y s epum кы = ч ght 
tion Valence of инешнен resulting fron ens аа t Шаг score on X This would b 4 
It i function: of Ше тар tests in quee" ее Ог опе might equate xtd 
Soup. POSsi one tion. | = 
r Sib š ч ts, 0 
Sconces, of Re outline briefly the follo wing score deviates оп youd be а at dein mim 
Source = tests ot SPAM ща еее ої equivalen ae might, for example, equate scores that 
t asuri error lies i oal duns чом jelded equal predicted scores оп one or another 
te в ing iatruments S e unreliability ai ne У iterion n this instance, of course, the use 
in ion : ity of the iid nema + uo s е. of different prediction criteria would yield dif- 
a с zi data. A sec = co obtained in + н ferent equations. here is probably an unlimit- 
У e nd source of елге я ed number of other definitions, each yielding а 
i nt conve sion line In contrast, all тей 


neg оп дея samples used to establish the 
thing Паб differ Different samples will yiel 
the оче а randomly from one another. A 
sign of error in equivalent scores lies 
the equating experiment and 


aper 
W 
as presented at the 1951 meetings of the 


uivalent scores in the 


except for random error. 
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2. Different lines will result when different 
populations form the basis for deriving the ta - 
bles of comparable scores. Тһе line of rela- 
tionship between two tests of different function 
will be one for, say, male engineering students, 
and quite another for, say, female arts students. 
This fact is immediately apparent if one were to 
examine mean scores of boys and girls on the 
Verbal and Mathematical Sections of the SA T. 
Girls characteristically score slightly higher 
than boys on Verbal, but they score consider- 
ably lower than boys on Mathematical. The 
**comparability"' line (or conversion line) be- 
tween Verbal and Mathematical scores as de- 
rived from male data would then be much differ- 
ent from that derived from female data. Conver- 
sion lines for tests of different function must, 
in fact, be different for groups that show differ- 
ent types of profiles on the tests, since the con- 
version lines themselves are a way of exam in- 

ing profiles on two tests, and the refore they 
must be normative in character. 

3. Differential selection will have a pro- 
nounced effect on conversion lines. Let us say, 
for example, that we collect data on the SAT and 
the ACE for a group of individuals inorder to set 
up а conversion table to go from scores оп one 
of these tests to scores on the other tests, and 
let us say further that these individuals have 
been explicitly selected оп Ше SAT. Thedistri- 
bution of resultant SAT Scores will, of course, 
be sharply curtailed. Тһе distribution of ACE 
Scores, on the other hand, will only be moder- 
ately altered. A conversion line derived over 
such data will be far different from a line der- 
ived over a group of unselected students. In fact, 
even if students used for data collection have 
been selected on an outside variable, say high 
school grades, their resultant distributions on 
the two scores in question will be different. 
More specifically, they will be unequally сиг- 
tailed in proportion to the relative correlations 
of the two scores with the selection variable, 
with the result that the mean and variance of 
one score will be more drastically altered than 
the mean and variance of the other score. A line 
of relationship derived even from these data 

would have limited value. In contrast, scores 

taken from parallel tests will be equally affect- 

ed by selection on an external variable, with the 

result that there Ж. be no systematic effect оп 
i ion. 

the oer emphasized here that the forego- 

ше s inherent in Ше development of а 
ing problem arable scores do not replaceor pre- 
table of ағы of error-sources Ша! were cited 
ena Me yes ection with equivalent scores that 
earlier in conn arallel forms. The problems 
are Hn да exist in addition to the 
of compa i res. 

ms of equivalent Sco теа 
acm to the systematic effects of (1) defini 


tion and method, (2) choice of population, and 
(3) selection, there are other problems, namely 
those of interpretation in considering a ta ble of 
comparable scores. For example, there is a 
constant danger that the converted scores will be 
assumed to possess the reliability and the valid- 
ity of the scale to which they are converted. 
While it should go without saying that ACE scores, 
however well they are converted to the SAT scale, 
are still ACE scores and retain all the basic char 
acteristics of the ACE, many test users will con- 
sider that once converted, they should behave in 
all respects like SAT scores. Obviously this i$ 
unjustified. The reliability and validity of АСЕ 
Scores that are converted to Ше scale of the Бі 
Will be no different from the reliability and valid- 
ity of the original unconverted ACE scores, ап 
will not resemble SAT data in the slightest. Also, 
if regression methods are used for establishing 
the conversion line, then the predicted SAT 
Scores will not have the same distribution ав ОГ- 
iginal SAT scores; the predicted SAT scores Wil 
have a regressed distribution. The pooling 0. 
these two kinds of distributions, taken from actu- 
al and predicted scores would therefore be йар 
ргоргїа{е. And yet it is for the very purpose 0 
pooling such data, or considering them in c on = 
junction, that such conversion tables are ordin- 
arily called for. And again, if regression meth- 
095 are used, then the prediction of grades spom 
predicted SAT scores will involve double regres; 
sion while the prediction of grades from origina 
SAT scores will involve only single reg ressior 
These two types of systems should not be merge ч 
although the need that has been expressed for de 
veloping such a conversion is, essentially, ga 
merge the systems or (which is equivalentin thi 
Context) to compare directly scores taken Ї г om 
different tests. 

To point up the fact that the SAT and the 250 
although presumably both measures of gen on 
Scholastic aptitude, are actually not equ ivalen 
forms, it will be of interest to examine the dif- 
ferences in item content and the correlations Бе 
tween the tests. The SAT is, for one thing, 2 
three-hour power test; the ACE isa one - hour 
speeded test. The SAT contains verbal апа!0- 
gies, verbal opposites, verbal completions, апо 
reading comprehension; the ACE contains verb? 
апа1овіез, same-opposite items, and definitions: 
The SAT contains arithmetic reasoning item 
and algebra and geometry items involving #12- 
mentary principles; the АСЕ contains arithmeti 
number series, and Spatial items (figure analo 
gies). At least from а cursory point of view, it 
would appear that the designs of these two test? 
are not entirely alike, 

The correlations among the parts of the SAT 
and the ACE and their reliabilities are given in 
Table I of the reference Material. They are av- 
erage figures taken in part from the booklet 


March, 1957) 


p lign Board Scores’’, published by the Со1- 
еве Entrance Examination Board, andalso from 
His and equating studies conducted by Educa- 
ee Testing Service, andare estimat- 
bilina unselected candidate groups. The relia- 
kas for the SAT are internal-consistency со- 
д € (KR-20); the reliabilities for the ACE 
с. Odified parallel-forms coefficients. The 
tions ген іп parentheses are estimated correla- 
Utes E \ееп true scores. Admittedly, the fig- 
only peg only rough estimates; they are given 
felt that ы PORGE Jof discussion. However, it is 
different Soon, erro are not substantially 
controlled body, at would be found in a carefully 
таја обвегсй in Table I that none of the esti- 
ва to ан сонди between true scores is very 
Were батар аз would be the case if the tests 
tion, . 90 1 €l. The highest true-score correla- 
Still shies 2 SAT-Verbal vs. ACE-Linguistic 
Variance y almost one-fifth of the true-score 
е sure te for. Consequently, wecan 
Cable to the the considerations normally appli- 
Applicable 1 Problem of equivalent scores are not 
tests à іп the present situation, since these 
It ig S Ot Parallel. 
Siven to Pinang that considerable attention be 
Purport iot non-unique character of tables that 


ranslat A 
е а a 
rent function, € Scores across tests of dif 


able th While there are по data ауа11- 
at һау 
Две оғ eman ВЕ Collected for Ше express pur- 
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meld different оп the SAT and ACE do in fact 
ра Пу to the lines of comparability. It is pri- 
Table Scor objective of multiple tables of com- 
; Hiid 4% that the present data are ad- 
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those data cannot be shown simultaneously with 
the data from the other three schools. 

Two groups of male liberal arts students are 
studied at College A, those entering college in 
1949 (N - 398), and those entering college in 1950 
(N = 448). Both groups took the 1949 form of the 
ACE College Edition. The form of the SAT prob- 
ably varies within the groups, but its identifica- 
tion is of no consequence in these data, since all 
forms of the SAT are related to a common scale. 

One group of 141 male liberal arts students is 
available from College B. This group entered 
college in 1948 and took the 1948 form of the ACE. 

One group of 154 students is available from 
College C, and comprises male students in liber- 
alarts and female students in a nursing school 
curriculum. Their year of college entrance was 
1951; they took the 1948 form of the ACE. 

Since conversion equations are available which 
permit the transformation of scores from the 1948 
to the 1949 form of the ACE, it was possible to 
combine the foregoing four arts groups in one 
presentation. 

Four groups of students are available at Col- 
lege D, the state university: 333 male liberal 
arts students, 582 female liberal arts students, 
134 male students in Economics and Business, 
and 75 male engineering students. All students 
entered the university in 1947. Тһе form of the 
test taken is unknown. Тһе information available 
is that the ACE raw scores were converted to 
percentile scores and then transformed to а norm- 
alized scale with M = 13 and о = 4. 

А separate set of data are available for 305 
freshmen entering the technological institution 
(College E) in 1950. For these students only 
SAT-M and ACE- Total (1948 Edition) scores аге 
available. Consequently, these data are given 
separately from the rest. 

Unfortunately, detailed knowledge is not avail- 
able regarding the selection procedures at the 
five colleges. It is known that the ACE was tak- 
en after admission at College A; the SAT was tak- 
en before admission in the regular CEEB series. 
However, SAT scores were reportedly not used 
for selection for the 1949 entering group, and 
only to a ‘‘limited extent’’ for the 1950 entering 
group. At College B the SAT was given after en- 
trance; nothing is known regarding the date of the 
ACE administration. At College C both tests 
were given after entrance. This appears to be 
similarly true at College D. Finally, at Colle ge 
E both tests were given after entrance; Selection 
was made on the basis of high school grade. 

It appears likely that in no case were the Stu- 
dents selected explicitly on either the SAT or the 
ACE. 

Seven tables are given, all derived si 
equating means and standard divisis s i i 
first three tables describe the conversions ob- 
tained for the arts groups—two at College A, one 


244 JOURNAL OF EXPERIMENTAL EDUCATION (Vol. 25 


TABLE I 
ESTIMATED CORRELATIONS, TRUE-SCORE CORRELATIONS, AND RELIABILITIES FOR 
SAT AND ACE 
© АУ — ЗАМ ë Е ag > Relisbilities -Q Белігрі1ібіев 
SAT-V -60 (.65) .82 (.90)  .35 (.h1) 9 
SAT-M Чо (.h8) .65 (.72) .90 
ACE-L «Ат (5% .88 
ACE-Q 86 
————— E M 
TABLE II 


CONVERSIONS FOR COLLEGES А,В, AND C---ACE-L vs. SAT-V 


TE MÀ oen 
ACE-L Scores 


SAT-V Scores 
слее А Со11еге А ) Range of Converted 
(19 9 oro) 1950 Grouj College B College C Scores 

№ = 59 N = N = 151 N = 15% 
ho 256 239 247 253 iT 
60 516 516 585 595 19 
80 516 512 522 538 26 
100 656 619 659 681 32 
120 796 786 796 824 38 


TABLE III 


CONVERSIONS FOR COLLEGES А, B, AND C---ACE-Q vs. 5АТ-М 


ACE-Q Scores SAT-M Scores 


College A College A Range of Converted 
(1949 Group) (1950 Group) College В College C 


Scores 
N = 398 N = hh8 N = ща N = 154 
258 252 214 208 
ej Ше 599 316 377 50 
50 550 566 558 545 28 
65 697 155 699 713 36 


ell ин 


Ma 
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TABLE IV 


CONVERSIONS FOR CCLLEGES А, В, б,---АСЕ-0 vs. SAT-V 


—————————— еек ————— 


ACE-Q Scores SAT-V Scores 
College A College A Range of Converted 
(1949 Group (1950 Group) llege B College C Scores 
М = 398 М = 448 poe. N = 15h 
ed (185) 225 (95) (279) 46 
2 555 579 555 546 55 
m 526 532 26 512 20 
T! 
80 (867) (840) (836) (846) (31) 
TABLE V 


CONVERSIONS FOR COLLEGE D---ACE-L vs. SAT-V 


a 


ACE-L Scores* SAT-V Scores 
Range of Converted 
Men Arts Women Arts Men Е&В Меп Eng. Scores 
М = 555 N = 582 N=134 N= 
h 2 215 285 202 83 
10 MP 106 412 388 28 
16 557 540 540 574 34 
22 698 674 668 760 92 
= (839) (вот) 195 (946) 151 


*Special scale used by College р. 


TABIE VI 
CONVERSIONS FOR COLLEGE D---ACE-Q vs. SAT-M 
ACE-Q Scores Е 
— вии Scores Range of Converted 
Men Arts Women Arts Men E&B Men Eng. Scores 
N 333 Н = 582 пета №=12 G — 
h 5 1 246 281 10 
10 е. um 582 429 106 
16 525 69 519 577 108 
ВЕ 691 615 656 125 110 
= (857) 761 192 (815) 112 


Жбреста1 scale used by College D. 
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TABLE VII 


CONVERSIONS FOR COLLEGE D---ACE-Q vs. SAT-V 


p a AM EE CE ee 


ACE-Q Scores* SAT-V Scores 
Range of Converted 
Men Arts Women Arts Men E&B Men Eng. Scores 
N = 555 N = 582 М = 13h N = 15 
4 (149) 214 243 (109) 15% 
10 337 592 370 295 9T 
16 525 570 498 481 89 
22 115 748 626 667 122 
28 (901) (926) 155 (855) 115 


*Special scale used by College D. 


TABIE VIII 
CONVERSIONS FOR COLLEGE E (N - 305) 
ACE-TOTAL vs. SAT-M 
= 
ACE-Total 


SAT-M 
Scores Scores 
го 215 ; 
60 357 
100 502 
що 645 
180 790 


March, 1957) 


ое B, and one at College C—separately 
M Wa. ACE-L to SAT-V, ACE-Q to SAT- 
bao i CE-Q to SAT-V. (The last of these 
ily be E гра рн not one which would ordinar- 
A e ed for; however, it is considered use- 
the Ж ме Er aui context in order to illustrate 
known to us conversion with two tests that are 
three tap] ave low correlation.) The second 
they have Fw parallel the first three except that 
College D “дер drawn up from data taken from 
omen in ран four different groups: Меп in Arts, 
in Economi rts, Men in Engineering, and Men 
Scribes n and Business. The last table de- 
SAT-M conversion from ACE- Total Scores 
legem. ' апа is based on data collectedat Col- 


T 
A, p inm tables for the groups at Colleges 
Which show describe a series of conversions 
but less a à reasonable amount of agreement, 
Ound if ve ied itis judged, than would be 

ег hang, en tests were parallel. Оп (һе oth- 
Not be Useful to not so disparate that they would 
Score transformat o in providing rough 


tis 
that the duserved in the foregoing three tables 
(in the АС Sest range of converted scores is 50 
e Smallest 9 VS. SAT-M conversion) and that 
Version). ^. 18 17 (in the ACE-L vs. SAT-V con- 
Version Showe wen the ACE-L vs. SAT-V con- 
lor the fo he smallest amount of disagree- 
а со groups of students, possibly 
Sibl е highest co between those two scores 
Been that disa he three. In general, itis pos- 
° Tved here greements of Ше magnitude ob- 
Fated. aes not excessive, and could be tol- 
io Sagreement ane that the small amount 
in. the fact ic the lines is accounted 
ively h at the four groups in question 
П Contrast to повепеоив in character. 
Thea d VI he the foregoing tables. Tables V, 
sp tables de quite a different picture. 
Тек Егоцрв zb Similar types of information 
eous Егочрв а College D, Ше state college. 
al е Ав чна Dot considered to be homogen- 
Dog; men, li ained above, they include liber- 
s апа | aenal arts women, men in есо- 
for ¢ 18 seen aret and men in engineering. 
Brea t? Егоцрв of the ranges of converted scores 
С. тег than for Students at College D are far 
D are Site or «he groups at Colleges A,B, and 
Sion ТШ Students fact that the groupsat College 
era lines differ’ іп One college, their conver- 
leges 8 Studenta e than the lines for the lib- 
ишед 2 Зейн Who come from different col- 
ity yo there ік to the type of conversion ob- 
`a greater within-college variabil- 
-college variability. It is the 


ура 
° А 
е Writer that this finding is wholly 
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explainable by the differences in type of curricu- 
lum within the college. Liberal arts students 
show conversion lines that are characteristical- 
ly different from those of engineering students, 
and male students show conversion lines that 
are characteristically different from those of fe- 
male students. These differences occur when 
the tests in question are not parallel forms. 

Finally, it will be of interest to examine the 
conversions obtained with data from College E, 
the technological institution. These conversions 
are summarized briefly in Table VIII. 

It is striking to note in Table VIII thatan ACE- 
Total score of 100 is found to be approximately 
comparable to 500 on SAT-M. If one were to 
generalize this conversion to all possible t y pes 
of populations, it would be necessary to conclude 
that the norms group for the ACE, which norm- 
ally averages 100 or so on the ACE, will score 
at 500 on SAT-M, and is therefore at the same 
general level of ability as the College Board 
standard group. However, in the light of the com- 
position of the College Board college population 
and also of the composition of the usual ACE 
norms group, it must be admitted that the con- 
clusion of similarity of general ability inthe two 
populations is untenable. Consequently, the 
above conversion cannot be considered a general 
law operating for all possible types of student 
populations and must be considered specific for 
the group studied, or at least for similar groups. 


Summary 


The present paper has addressed itself pri- 
marily to the argument that conversion lines 
which relate tests of different function are pri- 
marily normative in character, and willnothave 
generality of meaning. Different groups of indi- 
viduals with their own characteristic back- 
grounds, curricular emphases, and interests 
will yield quite different types of conversion 
systems—and these conversion systems will re- 
flect the differences in these groups. Conse- 
quently, it is considered erroneous to speak of 
“а conversion line’’ for tests of different func- 
tion. Other errors of bias in addition to those 
resulting from differences in groups also accrue 
in this problem of non-parallel tests, such as 
those related to the effects of selection andthose 
related to methodological definition—errors 
which do not appear in the problem of equivalent 
scores that are derived over parallel forms 
Finally, errors of interpretation exist in the con- 
version of scores on non-paralleltests which are 
not present in the conversion of scores on paral- 
lel forms. 
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THE COMPAR A BILITY OF THE BI-FACTOR 
AND SECOND-ORDER FACTOR PATTERNS 


JOHN SCHMID, Jr.* 
Personnel Research Laboratory 
Lackland Air Force Base, Texas 


IN 
mult RECENT years a variety of tools for the 


Ian 
een nd Ane ы of psychological data have 
Убіз has ditm (4). Among these, factor anal- 
nately, howe used quite extensively. Unfortu- 
acterized p ver, factor analysis has been char- 
ing à differs, 4 multiplicity of forms, each yield- 
prolite егеп type of solution. The end of the 
is assortm process which has given rise to 

(ог new t ent of solutions is not yet in sight, 
Yearly, I of solutions are being developed 
ег who eia net result is thatthe research work- 
9f intercor like to summarize a large group 
fronteg wid AUN in a meaningful way is con- 
Solutions, apparently divergent methods and 
tis ti 
"à the ae a we stop and take stock of some 
n Or maoga He and differences of various 
р 9n 18 hoe With the view that some unifica- 
ee t ия It is the intent of this ра- 
is ns two of th rate that under certain condi- 
cal except hw. most popular solutions are ident- 
(зі the bi-fac fon putational methodology; that 
bo 18 identical t Solution proposed by Holzinger 
Seq T 0 the second-order solution pro- 
thou the bi- ae rone (6), 
Em со Сог solution, the factors are or- 
Юргорр, ы Sisting of o 
Burt Gately desi ne general factor—more 
facto (l: cen Enated as a basic factor by 
might + 9Í a nine group factors. The common 
Appear s аме bi-factor solution 
ymbolically as follows: 


Vari G 
i ene 
— able Factor 


› 4 


Group Factors 


1. Б 

2. х = H HI 

3. x x 

4. х х 

5. х * 

6, х x 

Ta x ж 

8. x T 

9. x x 

"n x 
Мак Other 

е + 
Pas patea (е ш Solution which has received 
re fact e Popula ые simple structure. This 
NS Or oadings ecause the patterning of 


atio, logical 185 gives th 

1 e appearance of easy 
18 be n егргецаноп. However, corre- 
Ss € factors offset this apparent 


о 
е Pergo 
nn — 
el and Training Research Center, 


gain in ease of interpretation. Thurstone, іп гес- 
ognizing this defect, offers an alternate solution 
in which the intercorrelations between the pri- 
mary factors are factored completely. This com- 
plete solution, then, is used asa rotation matrix 
for transforming the oblique solution into an or- 
thogonal solution in which the group factors of 
simple structure are maintained. However, ad- 
ditional factors are produced which are a deriva- 
tion of the original oblique factor intercorrela- 
tions. 

When one second-order factor exists, this 
solution resembles the stepladder pattern of the 
Holzinger bi-factor loadings. Thomson (5: Ch. 
XIX) illustrates the development of a com plete 
second-order solution very clearly. 

A survey of the three tests by Holzinger (3), 
Thurstone (6), and Thomson (5) has shown по ex- 
plicit statement to the effect that the bi-factor 
solution and the second-order solution are ident- 
ical, although statements tacitly suggest simi- 
larity of the two solutions. The purpose of this 
study, therefore, has been to gather evidence 
about the identity or similarity of the two solu- 
tions. 

Holzinger has shown that the various factor 
solutions merely represent different sets of ref- 
erence axes placed in the common factor space 
of the test variables, and he shows that transfor- 
mation matrices exist which will carry one solu- 
tion into another. He presents an illustration 
(3:257-258) whereby an oblique primary pattern, 
which is related very simply to a simple struc- 
ture (2), is transformed into a bi-factor solu- 
tion. He indicates (3:258) that a primary solu- 
tion tends to have smaller communalities than 
its corresponding bi-factor solution because its 
common factor space is one dimension smaller. 
Question, however, arises if the number of di- 
mensions in a common factor solution does af- 
fect the communalities. In thefollowing example 
some evidence is presented to show that, rela S 
tive to the model used in this example, the com- 
munalities are unaffected by the added dimension 
found in a bi-factor solution. 

In order to investigate the identity of the bi- 
factor and second-order solution, a model cor- 
relation matrix was constructed. It was believed 
that an empirical correlation matrix, definitely 
having only one second-order factor which would 
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TABLE II 


PRIMARY PATTERNS 


манама Ш Йо Ж. 
1, 8 
2; 6 
3. `8 
4. `9 
5. 5 
6. " 
T. `8 
8. `9 
9. E 
10. `3 
il. `8 
12. `9 
Intercorrelations of Factors 
$ 
І п ш 
NM MM. ЕН 
I 1.00 21 27 
п 421 1.00 . 63 
ш ‚21 ‚63 1.00 
_— a sams tet ER AAAI 
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TABLE III 


TRANSFORMATION MATRIX 


Е' 
5 1 П III 
43 .9539 

„2 . 7141 

„9 


ТАВГЕ ГУ 


SECOND-ORDER FACTOR SOLUTION 


B 
Variable b I II ш 
1. 09 . 2862 
2. 18 . 5723 
3. - 24 .7631 
4. .27 - 8585 
ар so . 3570 
8. ғар - 4999 
T. : 96 .5713 
8. 555 . 6427 
9. 208 . 0460 
10. „21 1805 
1]. „12 "3487 
12. .81 “302% 


(Vol. 25 


March, 1957) 


ps кыы for this study, might be difficult to find 
Of yanio erature, In addition, sampling errors 
identity ur types might tend to conceal a real 
a model pcd mere similar guise. Therefore, 
structed eee matrix (Table I) was con- 
and a one у using the primary factor solution, P, 
lations Sie factor matrix of intercorre- 
Ша tween the primary factor, ф (Table II} 
Produce fie Operation, РфР', was performed to 
ations кез Correlation model. Тһе intercorre- 
by the a the factors, Q, were fac tored 
Tee uni : centroid method. One common and 
reported às factors were produced. These are 
v. ds Med matrix E' (Table III. This matrix, 
ting the e а transformation matrix for ro- 
er Soltis Y pattern, P, into a second-or- 
IV). This se This appears as matrix B (Table 
In the usual econd-order solution was computed 
Solution еси for constructing а second-order 
We have à s - XVII; 5:Ch. XIX). At this point, 
Produces aja, a -pider factor solution which re- 
ОГ our corr г correlations and communalities 
Question to о matrix model exactly. Тһе 
tes Tour е answered in this study, now, was 
factored Б Дата на matrix model, PỌP', is 
а Solution D € Holzinger bi-factor method, will 
Second-orde, міс is identical to the 
бінде factor solution which has just been 
" Holzi : 
(Череп ri bi-factor solution was calculated 
Ollowing the 9h the correlation matrix m odel 
Zinger (3) е methodology prescribed by Hol- 
identica] to The factor loadings were found tobe 
blisheq Mme in Table IV. Thus, it was es- 
th ype е Ше framework and limitations 
here is no di model set up in this problem, that 
wolutions quor eee between the two types of 
ко Seems "e for methodological procedure. 
wane between F conciliate the apparent differ- 
be 901 of thou e Holzinger and Thurstone 
noteq that " ht on factor analysis. It should 
he communalities for the primary 
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solution and the bi-factor solution are identical; 
во, apparently, communality is not a function of 
the number of dimensions used in obtaining 
either a simple structure solution or abi-factor 
solution. 

А second-order factor solution becomes con- 
siderably more complicated when more than one 
second-order factor is present. Speculation 
suggests that the factoring of higher orderlevels 
should be done successively with each resulting 
transformation, Ej, used to build a transforma- 
tion matrix which will rotate each higher order 
oblique solution into bi-factor form. 


REFERENCES 


1. Burt, Cyril. “Group Factor Analysis,’ Brit- 
ish Journal of Psychology, Statistical Sec- 
tion, ІП (1950), pp. 49- 


2. Harris, C.W. апа Enoell, D.M. “Тһе Oblique 
Solution in Factor Analysis, ? Journal of 
Educational Psychology, (1948), pp. 385- 


3. Holzinger, Karl J. Factor Analysis (Chica- 
go: University of Chicago Press, 1951). 


4. Rao, C. Radhakrishna. Advanced Statistical 
Methods in Biometric Research (New York: 
Jo iley and Sons, Inc., ). 


5. Thomson, Godfrey H. The Factorial Analy- 
sis of Human Ability (New York: Houghton 
Mifflin Co. , я 

6. Thurstone, Г. L. Multiple-Factor Analysis 
(Chicago: University of Chicago Press, 
1947). 


Ы 


| AN ANALYSIS OF VARIANCE ОЕ MULTIPLE 


ONE DIMENSION 


RAYMOND О. COLLIER, Jr., and CLAYTON L. STUNKARD 
University of Minnesota 


| MEASUREMENTS ON SUBJECTS CLASSI- 
FIED IN UNEQUAL GROUPS OF 


IN 
measur A E RIMENTS where more than one 
alysis is ei is taken on a subject, special an- 
ical indie аны because of the lack of statis- 

ypical of ск ence among the measur em ents. 
Subjects . experiments are those in which 
а tins first categorized into one of sever- 
urements i ODE. Thereafter, multiple meas- 
tions corre е made on each subject under condi- 
Ог more Bie ш ШЕ to all combinations of one 

Various Ys of classification. 

multiple ee have viewed aspects of the 
tions were тастаса нері problem. The founda- 
Pavers on тч by Yates (8, 9, 10) in his early 
Used extensiy Split-plot design which has been 
mE на и in agricultural experimentation. 
seem hae ee recent work on this general 
Hie ard рі that Бу Moonan (5, 6), Hoyt, 
за Collier (Гур (3), Kogan (4), Halperin (2), 
cla analysis КА This paper considers the model 
ec SSified into а design in which subjects are 
ue Irequen Several groups with possibly un- 
es Then ae along one classification dimen- 
sy binations Еһ subject is measured under all 

Stem, of a further two-way classification 


T 
Tie Model 


2 Letu 
і 5 
па R groups ee that N subjects are classified 
tr Subjects UCh that the rth group contains 
lise чи В with r-1,2,..., Rand Z nr 7 
рер; “МИ: " 
din «рани purposes this dimension, ex- 
втори i r not, is designated classification 
1,2 P be design Now, let the subjects within а 
der ay) nr. ач by the subscript s with 5= 
Senter the Combis the subject is observed un- 
іса У Subse inations of P categories, repre- 
Caten 01 dime ript p(-1,2,...,P), of one class- 
вес ries өленің (dimension “р”) with the Q 
meld way af oa erated Dy abel By su Он of a 
in Sion «ар classification which we name di- 
meas, a denoted E random variable thus 0b- 
Brou ement m by Храгв and refers (0 the 
Class; of dime ade on the sth subject of the T 
Bor Sificatio nsion “r” on the pth category of 
Y of classi dimension “р” and the qth cate- 
SSification dimension “а”. Now, we 


assume that Xpqrs is PQN-variate, normally dis- 
tributed with expected value a linear functionof 


fixed constants, 


Е(Храгз) = h + а (1, р) + (2, 9) + (3, г) 
+ В(1, ра) + В(2,рг) + ВІЗ; аг) 
+Y (раг) (1) 


where p is the general effect, 


and a (3, г) are the main ef- 
th, qth, and rth categories 
and ‘‘r’’, respec- 


a (1, p), a (2,9), 
fects for the p 
of dimensions «р», “а, 
tively, 


ва, ра), &(2, pr), and 8(3, аг) аге the interac- 

tion effects for the pth and qth, pthand rth, 
qth and rth categories of dimensions Єр" 
and “а”, “р?ала “г”, and “а” and “г”, 
respectively; 


Y (par) are the interaction effects for the pth, 
qth, and rth categories of dimensions ‘р’, 


“а”, and “г”, 


апа again, а5 before 


PNE а 


R, ands-1,2, Пг: 


The variance of Храгв is further assumed to 


be 
V[Xpars] = 9" (9) 


and any two measurements are assumed to be 
correlated with covariance 
Со\[Храгз» Xp' q' г! 5! | = ро? 


where p = 0 when г = г" and sZ 5' ог 
when r Z r' ands-S'. 


Тһе logic of this last assumption is that two or 

more measurements on the same subjectare sto- 
chastically dependent, i.e., they have a соуагі- 
ance different from zero, whereas two measure- 


ments from different subjects are stochastically 
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independent or have zero covariance. 
Outline of Analysis 

The analysis of the foregoing modelrequires 
that certain restrictions be placed on theparam- 
eters. Let these be 


2:5 = = х (1 
5 о(1,р)- z « (2, q) Е пга (3, г) pa » ра) 
= 2 В(1, ра) = 2 8(2, pr) = Enrf(2, pr) 
а р г 
(4) 
= 28(3,аг) = Enrg(3, ar) = 5 Y(par) 
а. г р 
- Ху(раг) - Е пгу(раг) = 0. 


Іп order to render Ше dependent m ultiple 
measurements statistically independent of one 
another, a modification of a transformation due 
to Nandi (7) is applied to the Храгв. Lettinga 
and b be particular values of pandq, гезрес- 
tively, we employ the following transformation: 


ү, a-1)Q+b 
abrs = Уа-позвтт гар ср 


(а-1) 9 b 
г Храгв + г Xaqrs 


Xa(b+1)rs 


— er _ 


(a-1)Q+b 
where a=1,2,...,(P), andb= 1,2,... , (9-1), 
а 9 
а сх 
Yabrs = уут | Ханша Ё З "bare 
ад 
where а = 1,2,...,(P-1), and b = Q, (5) 
LEX 
2 rs 
TEK ща 
Урдге 119 РО 


s a result of this transformation it ma y be 
m that the covariance of any two transformed 


variates is given by 
Соу | Урагв Ур! 4 г" 8] = 0 (6) 


ition, the (PQ - 1)N transformed уа ri- 
E. dune i.e., where p and q are not equal 
a Й 


(Уо1. 25 


to P and © simultaneously, have the variance 


91 = VÍ Yabrs] = (1-p)o? , (1) 
and Ше N remaining variates, Урогз, where p 


and q are equal to P and Q simultaneously, which 
may be labeled as ZpQrs, have variance 


93 = V[ ZPQrs] = [1 + (PQ-1) p] o? . (8) 
The Yaprs and the ZpQrs then, are two bu 
ate sets normally and independently distribu г 
within and between sets, but with different vari 
ances. Accordingly, we write two exprese ого, 
for the sum of squares related to each of thes 
Sets, respectively: 
(а) The Sum of Squares associated with Yabrs 
УУУУ [X - E(Yi 2-> >ГҮРоОгв 
Ж EL pars - Е(Урагз)] z z [ 
- Е(Үрогѕ)]? = 
(Ypers (9) 
ZZZzix -х -[«(1, p) +a (2, q) 
zzzz( pars „тв -[« (1, p) ««( | 
+8 (1, pa) «8 (2, pr) +8(3, ar) + Y (par)]] 
(b) The Sum of Squares associated with ZpQrs 
2 2 [ ZpQrs = E(Zpars)] 2= PQ р =. .rS 


- [в+<(3, г) |. 


(10) 


It should be pointed out here that the sum z^ 
Squares in the right-hand side of (9) includes fin 
the parameters of (1) except p and с (3, г) у 
the right-hand side of (10) includes only thes 
two parameters. 

Employing normal regression theory 0 jJ 
equivalently by the method of least square 
quantities (9) and (10) above provide estimate | 
of the parameters involved in each set. By we 3 
known methods we may use these estimates ! ы 
Order to generate tests of hypotheses on the Ж 
rameters. The quantities necessary toperfor ar- 
these tests are presented in usual analysis of Y 
lance form in Table] together with the relate 
hypotheses, the 

First, we present tests of hypotheses оп | 
Parameters (раг), 1, ра), 8(2,рг), В(3, 4 hy- 
X (L, p) and a (2, а) involved in (9) above. The; 
pothesis concerning the interaction “р ж "а 
“г”, Ha: Y(bqr) = 0, is tested by referring 
ға) =М. 5. (“рх ча’х“г”)/м. S.[Error (1)] = 


8.8. Cp" X^q*x'r")/(-1)9-108-1) to ЕР 
S. S.[ Error (1)] /(N-R)(PQ-1) 


-1)(Q-1)(R-1), (N-R)(PQ-1), «1, i.e., the upper 


M. 
arch, 1957) COLLIER - STUNKARD 257 


TABIE I 


ANALYSIS OF VARIANCE FOR DOUBLE CLASSIFICATION OF MULTIPLE MEASUREMENTS ON 
SUBJECTS IN UNEQUAL GROUPS OF A SINGLE CLASSIFICATION 


C————— eel 


Source of Hypothesis Degrees of 
Variation Tested Freedom Sum of Squares 

c — 
Error (1) (N-R) (Р9-1) а- (юг) +i 


"p"x"q "xp" В (1) 17 (0072-0 (2-1) (9-1) (R-1) b - (с+й+е) + (g+h+ 1) = 3 


"P'k"q* Н(г):ВО.Р9д-о (P-D (9-1) e - (geh) + j 

"px et (s) (2 pr)» (Р-1) (8-1) d- (gri) +3 

па кари нү. у:8(5,аг)=0 (2-1) (а-1) e= (1+1) + j 

"р" н (5 102 »»)-0 Р-1 є- 3 

а" H (с) “(2 ,а)-0 9-1 h- j 

Withi 

Error (2) N-R f - 1 

"г" нту :а(3,г)=0 8-1 1-2 

a 

— = ===. 

Bet 

Total PQN-1 а= 4 


No Mean Square column 15 presented since the hypothesis tests are given 
Specifically elsewhere. However, t for the mean squares 
9f Error (1) and Error i" are found to be бу and 92^, 


expressed in [7] and [8 


respectively , as 


Š The lettered quantities are defined as follows: 8 = 2 2 2 2 PT 
э ЕЕ Кш) [Mele = 48 қамы a = p BQ хо) e 
АРСР хаг) Im: f = 228 8 Хор) Ie 8 = BEES хага) /QN, 
з 2$ HE — = y G i 2 Храг ні % а E š Tages) Ран 
With p-1,2,-..,P, де, 2, Q> p21,2," й» S912, ny and N = Z пр. 
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ТАВТЕ ІІ 


RAW DATA FROM А RELEARNING EXPERIMENT 


Group 


Control (r-2) 


Experimental (r-1) 


List (p) 
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List (p) 


List (p) 


Trial (q) 


Subject Trial (а) 


Trial (q) Trial (q) Subject Trial (а) Trial (а) 
Number Number 


Subject 
Number 


$ 


2 


5 


10 
10 


10 


5-19 


5 


6 10 10 
5 


10 
6 


3 10 


4 
5 


21 
22 
25 
24 


4 


25 


4 10 10 


10 10 


5 


+ 


26 


10 


10 27 


8 


6 


6 10 10 


28 
29 


7 10 10 


11 


1 


12 
13 
14 
15 


50 


12 
15 
14 
15 


10 


10 


51 


52 


10 


55 


16 


54 


16 


17 


7 10 


1 


4 


AT 


18 


18 
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TABIE III 


MEANS BY LIST, TRIAL, AND GROUP FROM A REIEARNING EXPERIMENT 
c t t А о Сынык NH) 
——I C 


' Trial (а) 

Group n, List (p) БЕРЕР, сы RR 

1 2 5 All 

тыы у уо ух сы МЫНЕ MOS... 

Experimental 34 1 2.21 5.24 7.65 5.05 
(г=1) 

2 2.76 5.94 7.82 5.51 

Both 2.49 5.59 7.74 5.27 

"NER... || ЗО МАЛ 

Control 18 1 5.17 5.50 8.00 5.56 
(гег) 

2 5.61 6.28 8.06 5.98 

Both 5.39 5.89 8.05 5.77 

Total N-52 1 2.54 5.55 7.77 5.21 

2 5.06 6.06 7.90 5.67 

Both 2.80 5.69 7.84 5.44 
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TABIE IV 


COMPIETE ANALYSIS OF VARIANCE ОР DATA FROM A RELEARNING EXPERIMENT 


— —P ”[ 


Degrees 
Sum of Mean Test of 
Source of Variation of Е 
Freedom Squares — Square Hypothesis 
Error (1) 250 411.1645 UE M — 
List x Trial x Group 2 0.1409 0.0704 


IT Accepted 
("p" x "q" x ни) 


a cu т DON 


Residual (1) 252 411.3054 1.6522  ---.--- ^ ........ 

List x Trial 2 4.7501 2.3750 1.455 Accepted 
най пай 
бр” ae Чай) 

List x Group 1 0.0525 0.0525 ....... Accepted 
(при х Ян) 

Trial x Group 2 5.7832 2.8916 1.712 Accepted 
(ар х пи) 

List ("p") 1 


16.6155 16.6155 10.180 Re Jected 
Trial ("q") 2 


1,329.8269 664.9154 407.575 Re jected 
Within Sub jects 260 1,768.5534 
Е 


ггог (2) 50 857.0512 16.7410 


Group ("r") 1 


17.5769 17.5769 1.050 Accepted 
Between Subjects 51 854.6281 


511 2,622.9615 


14 significance level of .01 was employed. 


Магеһ, 1957) 


nor of the F distribution with (P-1)(Q-1) 
dom ue (N-R)(PQ-1) degrees of ігее- 
as F| (РИ 3 5 is, under На), distributed 

If the- )(Q-1)(R-1), (N-R)(PQ-1)]. 
еи (par) are zero, the hypothesis on the 
by и. x “а”, Hey P (1, ра) = 0, is test- 
Residual m e = M.S. (p^ x **q")/M. S. 


int 


8.5.(р”х“ФЭ/(Р-1)(0-1) 
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so-called re-learning procedure was continued 
for three trials. The measurements recorded 
for each subject consisted of the number of ‘‘cor- 
rect" associations made during the testing on 
each list and trial. 

Before applying the analysis presented in Ta- 
ble I, it is first necessary to recognize that the 
following assumptions are made. The variance 


S. 
(S.S [Error] 4 8:8 (px qx 77)? /L(-1(G9-1(-D + (N-R)(PQ-1)] 


to F 
(nj P MO, а. f. [ Residual (1)] -(Р-1)(0-1) 
otheses BE pd kL ‚© }. The two other hy- 
эрг) = 0 e interac tion ср x tr, H3): 
і 0" and the interaction ‘‘q’’ X “г”, H(4): 
Ң(2), the nu are tested in analogous form as 
асер егар only differing. 
esis, H ning the main effect “р”, Ше hypoth- 
F(5) = Prop) - 0, is tested by referring 
Ф.Г Веки р”)/м. S. [Residual (1)] to F((P-1), 
Ypothesis ча! (1)], с}. Finally, the remaining 
9 =0 "peace to the main effect “а”, H(6): 
estin а tested in a parallel fashionas н). 
г) involved lypotheses on parameters p anda (3, 
esis cone in (10), we consider first the hypoth- 
rag Thee the main effect “г”, H(7):«(3, 
MS. test consists of referring F(7)-M. 
ough the org (2)) to F[ (R-1), (N-E),-] 
T :п=0 ршен on Ше general effect, 
able ү, thi as not been listed specifically in 
F(8) = S hypothesis may be tested by refer- 
Specia Да S. | Error (2)] to F[ L, (N-R), «] 
Potheses H tention is called to the fact that hy- 
te од ette c) to H(g) representing the four inter- 
the with a sa the two main effects are to be 
sig main eff ifferent estimate of error than is 
On “ys ems related to classification dimen- 
т ей to group the subjects. 


Арріїсан 
Blication of the Analysis 


Олат, 
wich example of a specific problem in 


тета ы даль the control subjects were not 
Aggy E the t is special training consisted of 
tain абез de words in List 1 with "correct" 
Ben кашлы the ten words in List 2 with cer- 
Soci) the a associates. After his training 
Шаде ну words with the “соггесе” as- 
“diate + е read to both groups followed by an 
esting in multiple choice form. This 


зе 
E 
ng с 
ar 
lson, Dean of Students, Bemidji Ste 


of any observation is assumed to be 02, and any 
two observations taken on the same subject are 
assumed to be dependent with covariance equal 
to ро2. Any two observations on different sub- 
jects are assumed to be independent and hence 
have zero covariance. 

The measurement taken on the sth member of 
the rth group of subjects on the qth trial of the 
pth list of words may be designated as Үрагв» 
where p = 1,2, q= 1,2,3, r= 1,2, and 8-1,2, 
... nr With n, = 34 and n; - 18. The raw data 
for this experiment are presented in Table II, 
while the means of the measurements are to be 
found in Table III. The basic values needed for 
the sums of squares in the analysis of variance 
outlined in Table I were computed and found to 
be as shown on the next page. Substitution of 
these values in the expressions of Table Itogeth- 
er with the proper values (N = 52, P = 2, Q = 8, 
and R = 2) for computing the degrees of freedom, 
and proceeding to test the null hypotheses as out- 
lined permits presentation of the complete anal- 
ysis of variance in Table IV. 

Examination of the table of means (Table III) 
together with the results of the tests of the vari- 
ous hypotheses (Table IV) leads to the conclusion 
that List 2 is more difficult to learn than List 1, 
and that significant gains accrue from trial to 
trial. However, the experimental group does not 
perform significantly better or poorer than the 
control group, and none of the three ways of clas- 
sifying the measurements interacts withthe oth- 
ers, that is, the classifications of List (‘‘p’’), 
Trial (“а”), and Group (“г”) are independent of 
each other. 


Summary 


A model is set forth for a specific class of 
experimental designs in which subjects classi- 
fied into several groups with possibly unequal 
frequencies along one dimension are measured 
under all combinations of categories of a further 
two-way classification system. Because the mul- 
tiple measurements on each subject are logical- 
1у assumed to be dependent, they are trans- 


te Teachers College, Bemidji, Minnesota. 
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11,864. 0000 


а = b = 10, 615. 7843 
е = 10, 594. 2255 f = 10, 095. 6666 
i = 9,258. 6154 я | = 9,241.0385 


formed into independent variates. The transfor- 
mation, an outline of the analysis, and the ap- 
propriate analysis of variance with the neces- 
sary equational quantities to use in testing hy- 
potheses for the general case are presented. To 
illustrate the procedure, data and analysis fora 
special case of the design are also presented. 
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ligence, achievement, judgment, interest, per- 


T 


INTRODUCTION 
sonality adjustment, aptitude, and other tests. 

. SINCE the Such a testing program, combined with interpre- 
Ing problems end of World War II many perplex- tation of the results and information about appro- 
education in Rein ыны. the need and purpose of priate vocational fields, has led many people in- 

een brought D. modern, complex society have to work they might not otherwise have done, but 
n €ducation Ad public attention. The whole aim ior which they are found to have the necessary 
ms 1Чча1 Sete s із to equip each in- qualifications. The result is that their whole ed- 
N he may cont for a better life and to guide him ucational program focuses on a definite aim, and 
8 recent yem EUH to the betterment of society. in turn, they find the satisfaction that only those 
{ Ore to гевре › educators have come more and who are doing the work for which they are best 

erences, ct the importance of individual dif- suited can know. 

Personnel work in a college Or university 15 


N 
what they m students are exactly alike in 
ет to li © get through education to enable 


ve 

ud not an mn To meet these varying needs 1 

свресаЦу sin ask for educational institutions, which will stimulate him and assist him, through 
eldom а се the students, themselves, аге his own efforts, to develop in body, mind and 


wa Anci UNE 
therefore vem: of their own particular needs, and character to the limit of his individual capacity, 
ts, andaptitudes for growth.'(108) 


the systematic bringing to bear on the individual 
student all those influences, of whatever nature, 


teachers ane ce largely on the advice of parents, ability, interes 
honerican se BR. Often Ше products of our Research must be brought to bear upon these 
"iue unhap 0015 and colleges have reached adult- roblems of preparing, assisting, and stimulat- 
elves, à Ру in the work in which they find them- ing each student in selecting the occupation for 
which he or she is best fitted, in the light of his 


nd di 
tot in lir iscontented, therefore, with their 


to fulfil] is urely for them education has failed or her total educational, vocational and social 


ter diving. aim: to equip the individual for bet- potentialities. 
ealizin 
зае that inp Such conditions have prevailed «ft is costly for society to spend time 
уан Power to сап education has not done all with- and effort in educating individuals to do 
"x educators оисе well adjusted individuals, tasks which they, at best, will perform 
ex cial effort b in recent years have put forth on a very low level of efficiency. Both 
о Perimentin, Y evaluating their own work and the individual and society have a stake 
x 9f their аа new ideas and procedures. in education." (87) 
орде, among on and experimentation has ЕРІ 
{есы ДЕ guid er things, an organized program The great growth in college enrollments, the 
Ive data f ance, based, tosome extent, on ob- changes in the availability of positions for college 
rom psychological measures, intel- graduates, and the development in the science of 
ње wri 
and cone? 15 especi i dgerton, University of visconsin, for his i . 
Big Оба eneourazens hg ede to Professor ОГ thts investigation, also sincere thanks are е, M 
a os Ше. Due n А Margaret Ae Копії, and 365 кована as Thompson of the Univer- 
8 Wisconsin who се » É T rance of t: project, Е. 
=e sin who contributed рег РД Е ino Era реве à слезе, fibancial түзү cm 


Sear ed to the Nati + 
the Ch study М е National Foundation fo: я Вб ог the Department S 
ocu imr Dore а e 
bac = hose forme sconsin, particularly, a who gave 80 fucely of their critici ho be 
mer graduate students 8% Dope. | ісівт and sugges- 


uring t 
5 the progress of this stoya ск. Mo .. i 
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testing go hand-in-hand in making the problem of 
prediction of vocational success of greater im- 
portance than ever before. Те need for the im- 
provement of methods of prediction and selection 
for the guidance of entering college students is 
evident in nearly every phase of modern profes- 
sional life. Higher education must become іп- 
creasingly efficient by basing its plans and prac- 
tices on the positive objective findings of statis- 
tical, laboratory, and experimental studies. 

This investigation points the way for increas- 
ing the accuracy of knowledge about the possibil- 
ities of achievement and success of some of our 
entering college freshmen who desire to enter 

physical medicine. 

Consider, for instance, the students who in- 
tend to become physical or occupational thera- 
pists. There is room and need in society for 
men and women who are able practitioners of 
physical medicine. There is hardship, however 
on the one hand, for the student trainee who fin- 
ally gets through and is ill-fitted to the profes- 
sion, and, on the other hand, for the disabled 
public when served by poor practitioners. 

Harold Clark and others (15) have studied oc- 
cupational distribution and trends. They have 
found that there is no close relationship between 
the number of persons preparing for an occupa- 
tion and the number of persons needed each year 
by the occupation in question. There consequent- 
ly is seldom a close relationship between the sup- 
ply of workers prepared for an occupationand the 
number of qualified employees the occupation can 
actually absorb. 

This fact is important because it shows clearly 
that our prevailing methods of vocational guidance 
ordinarily are trustworthy predictions of Success 
or accurate data which are not used Sufficiently 
on labor markets and employment objectives, 
Since it is society, as well as the individual, who 
will benefit, it is an obligation of the schools and 
colleges to make objective and subjective meas- 
ures of the student's abilities, capacities, inter- 
ests, personality and social adjustment, and apt- 
itudes. Assume that there are 200 individuals 
wishing to prepare for a certain vocation; sup- 
pose further that through the application of apti- 
tude and related measures and other available 
data the department's faculty finds that only 100 
of the individuals can profitably prepare them- 
selves for the vocation. Some error is certain 
to result in this selection, so that of the 100 зе1- 

ected not all will prove to be of the most promis- 
ing 100. Some of the rejected 100 will be those 
who would have made good in the preparation and 
training for the vocation and in the vocation it- 
self. . . 

There are a few fields in which guidance can 
be conducted with considerable promise е но 
cess. These fields are recognized as pro = 
sions, which require some lengthy preparation. 


This fact alone operates as a method of selection, 
since only those who can afford the time and 
money involved in such preparation can be ехрес- 
ted to enter it. From the point of view both of 
the individual student and of service to society, 
something more than such a chance or haphazard 
method of selection is needed. The individual 
students should be protected against unnecessary 
disappointment and disillusionment which result 
from failure after once being admitted to an іп- 
Stitution of higher learning for professional ргер- 
aration. The interests of society should be safe- 
guarded against inefficient persons by the main- 
tenance of adequate educational, vocational, and 
social standards. Itis the duty of our higher in- 
Stitutions to discriminate adequately between 
those who show high promise and those who offer 
little likelihood of success. 


SECTION I 
NATURE AND SCOPE OF THE STUDY 


A. Nature of the Problem 


FOR EFFECTIVE guidance of students 
into college work, articulation between the stu- 
dent's capacities, interests, aptitudes, person- 
ality, and possibilities of achievement is naues 
Sary. The place of the college in the education 
Scheme is an important item in considering the 
problem of selection, admission and prediction. 
Guidance of pupils from high school into college 
Should be as thorough and complete as possible. 
College to most people is a preparation directly 
Íor vocations which requires serious considera" 
tion from both student and faculty. 


“Мо subjective or objective method of 
estimating success has as yet been in- 
augurated which is perfect. It is true 
that the most valid method for finding 
out whether or not a Student can achieve 
а certain scholastic Standing or be suc- 
cessful in an occupation is for her to 
try it. If, for instance, a student wants 
to become an engineer, the most valid 
method for him to find out if he can be- 
come one is first to attempt the training 
necessary and then go out and attempt 
the job. This trial and error method, 
however, is costly both for the individ- 
ual and the School, let alone society. 
For the individual it is a costly proced- 
ure because he may spend much time in 
trying out various lines of work." (24) 


(Vol. 25 


Е. 


c АШЫ Ас ыыы 
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Deed үс problem of this investigation is 
the ме ion of certain factors for estimating 
(ог admis performance of individuals applying 
physical pages to or having actually entered the 
Universit r occupational therapy courses at the 
Proble 2 of Wisconsin. In other words, the 
knowled: 3 т to determine how to use best Ше 
ata of 4, а number of characteristics and 
ical Medici ents entering the Department of Phys- 
as Measured. in predicting their future success 
Problem wa: by certain selected criteria. The 
Curate es = = to determine more ac- 
methods for i of predicting success and to set up 
might be u interpreting the data resulting which 
Sed by the faculty members іп Physical 


€dici 
деңісіпе for selection and guidance of their stu- 


B. 
Purpose of the Study 


To 
Dlicants to a wise selection from the list of ap- 
Courses ae ee and physical therapy 
5 даа been recognized as а formidable 
e rog. of considerable dissatisfaction 
epartme 5 of previous methods of selection, 
ПИ na physical Є has been 
Several test is cooperative study with the use of 
Pecial 86. (intelligence, interest, achievement, 
io. апа used personality and social adjust- 
ERU © su gment), a rating scale, and a data 
“Чеп, Pplement other methods of selection of 


With th 


. The 
etant ratan, of this study is to discover suf- 
cj, Success iable, and valid means for predicting 
Пе at the e students entering Physical Medi" 
Қы "есе of Wisconsin, knowing that 
Stud S Sele ors will help in the initial and con- 

4 әсте of students. И the selection of 
digg. Made physical medicine can be more effic- 
Appointee ДЕМЕ waste for Ше institution and 
Мед electi nt for the individual can be prevent- 

dicine, Ve devices are necessary for physical 


i 9 pr 
ло ave in the initial selection of students 
valid "4. testing program which will pro~ 
Tent tive dat: reliable information (objective and 
and ° овесени about the intelligence, achieve" 
Meng оста adiu: Special aptitudes, personality 
“иран Sick see and reasoning and judg- 
i Sura dert in physical therapy and oc- 
by. 

° p а purpose of ће testing program 15 
ang поет а which will help in the solution о 
thro УФ саты Selecting trainees іп occupational 

t e „агару, Тһе ригрозе of the study 
has Verage е of the tests, a rating Scale; grade 
e » апа predicted grade point average 
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+, ед the following objectives: 


Project, 
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1. To provide accurate and meaningiul meas- 
urements of the individual's intelligence, inter- 
est, achievement, special aptitudes, personality 
traits, emotional adjustment, and judgment. 

2. To assist in the selection of students with 
potentialities to make good physical or occupa- 
tional therapists, and to arrange guidance tow- 
ards other fields for those who seem unsuitable 
for such specialization. 

3. To use measuring devices which will re- 
duce the amount of failures and consequent elim- 
ination of students from the training courses, 
since the latter, of necessity, have had to estab- 
lish enrollment limits. 

4. To provide diagnostic and remedial meas- 
ures which will keep maladjustment аса minimum. 

5. To develop а practical means of predicting 
success in physical ог occupational therapy from 
combining the student's scores опа test battery 
and other pertinent data. 

6. To install a basic functional guidance and 
testing program which can be developed as anin- 
tegral and functioning part of the total school pro~ 
gram of every physical and occupational thera- 
pist. 

7. To select and/or devise professional and 
standardized tests which, in combination with 
each other or with other measures, may form a 
selective measure and prediction of the efficiency 
of therapists in Physical Medicine. 

The present study has been made possible by 
the cooperation of the University of Wisconsin 
Medical School, the Department of Education, and 
the National Foundation for Infantile Paralysis. ж 
This investigation was begun during the second 
semester of the 1945-46 school year and contin- 
ued through both semesters of the 1946-47 school 
year at the University of Wisconsin. 

The professional divisions of medicine are in- 
terested in having the various departments of 
physical Medicine, occupational, and physical 
therapy, Supply competent and well-trained ther: 
apists. In order to do this, the schools and their 
faculties understand that they must attract and 
select for training those students who are most 
likely to succeed and become able therapists 
All of the schools of physical medicine emplo 
some method for selecting their students from 
the applicants who seek admission. Mostofthe 
study the student's previous School record а 
insist upon а personal interview, and some d = 
mand that the student demonstrate a certai 

tence in specific examinations. аны 

Some schools of occupational and physical 
therapy have not had as many applicants as tt 
would wish for and this may have caused a f hey 
to accep: students whose chances for bx 
competent therapists Were not very MEE 


а all of the financial assistance needed for this 
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While this has undoubtedly acted as a challenge 
to the schools and has made them redouble their 
efforts to produce the best possible therapists 
from these poorer students, yet Physical Medi- 
cine desires that the efforts of its schools be con- 
centrated on training those who are most likely 
to become top-quality therapists. 

It has been the hope of many individuals, groups, 
and committees during the past years that atten- 
tion be given to the use of aptitude tests for im- 
proving the selection of therapy students. In 19- 
45, the Medical School and the Department of Ed- 
ucation of the University of Wisconsin appointed 
а committee to study this problem. 

In February, 1946, a committee comprised 
of Dr. Alanson H. Edgerton, Professor of Edu- 
cation, who is in charge of Guidance Training 
courses; Dr. Elizabeth Grimm, Medical Director 
of the Department of Physical Medicine; Dr. Nick J. 
Topetzes, assistantprofessor of Education, Mar- 
quette University, and authorof this study; Miss 
Caroline G. Thompson, Technical Director of the 
School of Occupational Therapy; and Miss Margaret 


A. Kohli, TechnicalDirector of the Schoolof Phys- 


ical Therapy, decidedafter considerable discussion 
to use twelve tests covering the areas of intelli- 
gence, interest, achievement, special aptitudes, 


personality traits and social adjustment, andprac- 


tical judgments. 

It was felt that the place to start was with the 
administration of this battery of tests, already 
accepted as reliable and Significant, from which 
a profile on each student could be drawn. The re- 
sults of these tests were to be compared with the 
subjective rating of the students by their instruc- 
tors and clinical supervisors during their train- 
ing period and with the rating given them by their 


employers and supervisors at the end of their first 


year of vocational experience. The rating form 
which was used is discussed in Section IH. It 
was hoped by such correlation that certain tests 
would stand out as being of significance in the 
evaluation of the aptitude of the student, If these 
tests would not accomplish this purpose it would 
then be necessary to develop one battery which 
ығ Ше selection of students for Physical Med- 
icine (especially with the current influx) the Un- 
iversity is concerned with maintaining high stand- 
ards for admitting students into the Department. 
That is why the need of some methods of selec- 
tive admission to the study of physical and осси- 
pational therapy has arisen. The increasing num- 
ber of students in Physical Medicine, the limita- 
tion of clinical facilities and the desire to pre- 
vent overcrowding in the schools made it seem 
necessary that an experimental guidance andtest- 
ing program be developed for this = а 
The Department of Physical Medicine natural y 
desires the student who is likely to succeed in 
the field because he or she has the potentialities 


to make a good therapist and the safest guaran- 
tee is the incorporation into the Department of 

a basic testing and guidance program with selec- 
tive devices which possess the greatest predic- 
tive value. 


C. Review of Related Literature 


Many studies have been made related to the 
Selection and prediction of students in college. 
This problem of college success and vocational 
Success has been confronting the schools in our 
democratic Society for many years. Educators 
have been probing into this matter hoping to find 
Some reliable and valid means for selecting stu- 
dents and predicting college and vocational suc- 
cess. 

Douglas s and associates (25) of the University 
of Minnesota found that: 


1. Success can be predicted more accurately 
in curriculums to which first-year college stu- 
dents are admitted, e.g., engineering, nursing, 
pharmacy, agriculture, and in the School of Bus- 
iness Administration and College of Dentistry 
(coefficients of multiple correlation run from 
- 70 to . 80), and less accurately in the other сиг” 
riculums to which students are admitted only af- 
ter two or more years of college work, e.g., law, 
medicine, business administration, and educa- 
tion (best coefficiencies of multiple correlation 
run from .60 to . 70). 

2. Prediction for vocational success can be 
made more accurately for the poorest and the 
ablest students than for those of medium ability. - 

3. Tests of general mental ability and achieve 
ment not only are less closely correlated with E 
Scholastic success than the more pertinent spec 
ial aptitude tests, but they add definitely less to 
multiple correlation coefficients. ight- 

4. Interest scores were found to be only sli£ 
ly correlated with marks and to add nothing to 
other variables for prediction. 

5. Two general reading tests (speed) were 
found to be less closely correlated with success 
than other variables requiring less time. 


Segel (93) found that the correlations between 
general mental tests and achievement tests аге " 
lower than those between the same tests and ge 
eral college Scholarship. Those with general 
achievement tests are likewise slightly lower НЕ 
while those with specific traits, interests, арі 
tudes, or achievements are approximately the 
Same as the relationships between mental gel 
and grade point average. These data led бере 
to the conclusion that for predicting success in 
а college program, tests of Specific aptitudes; 
interests, and achievements are the best. din 

Although the number of individuals engage 
various professions is small compared to the 
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ыы of persons employed, these оссира- 
Po TE the vocational goal of many who 
ВЕЕР possibly succeed. The fact that the occu- 
e n ang professions require college training 
who a asa selective factor which barred many 
the Дт incapable of succeeding. Fortunately, 
fee the nt expansion of higher education intensi- 
most се for accurate predictions of those 
ing ten to be successful in professional train- 
justment. and in subsequent occupational ad- 
Ж. а level of scholarship, results of gen- 
eristics ise tests, and personality сһагас- 
Cate г Бееп general criteria used to indi- 
Cine, Nur Ss in professional courses like Medi- 
dministrat Law, Dentistry, and Business 
eria utri In addition to these general cri- 
Special а uments of prognosis, rating scales, 
ptitude tests, and judgment scales have 


сеп 4 я 
aptitudes Ped to indicate specific professional 
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ON e medical schools have always been 
companied Videns standards of scholarship ac- 
by membe y personal characteristics as judged 
teria TS of the schools have been used аз cri- 
nation of A ) Recently, however, Ше Asso- 

Sing a pro merican Medical Colleges has been 

Consists oo test devised by Moss (71) which 
memory s comprehension and retention, visual 
їп Scientific w Y for content, logical reasoning, 
nid colle ° Vocabulary, It is now being given 
пана to ` Тһе scores bear a significant 
се dica] Aptitu Success in medical school. The 
of th of the € Test scores predicted 53 per- 
bi nose With pos and excluded only 5 percent 
qata tion of th igh scholarship records. A com- 
only Predicted test with premedical scholarship 

y erce 69 percent of failures and excluded 
а. use ез of those with high average marks. 
ог ‘Васа, е и Seems to require more 
bes ®chanicals motor ability than medicine, tests 
field used to aptitude and manual desterity have 
ity ? Schultz (92) 5. success in this field. Inthis 
Seco Otor lear 2) gave tests of motor adaptabil- 
bitip Year d Малы and general intelligence to 
lent; У Score ental students. The motor-adapt- 
ед that 5 to Yielded the highest validity coeffic- 
Chan, t five m ) Harris (43), however, report- 
Ces. е Correj ri anical-aptitude tests gave only 
ore In qq, tions with his two criteria of suc- 
ang Slateq 2l scho ° i 

ч, „ated 5 01001. The Otis Intelligence Test 
Ray, When сот With first year average marks 


wa multi] bined with predental scholarship, 
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honor point ratio and the actual first- 

grades. These predictions were за n 2. 
basis of predental grades, and scores on mental 
ability test, metal filing test, visual memory 
test, and finger dexterity tests. 

MacPhail and Joslin (65) found that 124 girls 
in training at the Rhode Island Hospital were su- 
perior to 124 students in training at another in- 
stitution because the students of nursing educa- 
tion at Rhode Island Hospital were selected by 
means of intelligence, reasoning, personality, 
and achievement tests. 

In Law, the Ferson and Stoddard Law Apti- 
tude Examination is given, although similar tests 
have been developed at Yale, Columbia, andother 
universities. It measures capacity for accurate 
recall, comprehension of passages read, ability 
to reason by analogy, ability to reason analytic- 
ally, and skill in pure logic. Research has shown 
that students ranking below the median on the test 
subsequently fail in such large numbers that such 
scores may be interpreted as indicating lack of 
legal aptitude. 

Gaudet and Marryatt (35) found that this test 
was better than freshman marks in predicting 
marks in law school. 

Crawford (19) reports that the School of Law 
of Yale University adopted the practice of selec- 
tive admissions, and about 1926 limited the num- 
ber to be admitted each year to 100. In addition 
to the general requirements —college record, 
letters of recommendation from college instruc- 
tors, and interviews—experiments were under- 
taken with aptitude tests. The first tests used 
were the Thorndike CAVD Test, which took four 
hours and a test of twenty minutes constructed 
by Chapman. The average correlation of the 
Thorndike Test was +. 45, of the Chapman Test 
4.40, both lower than the correlation between 
college grades and first year grades in law school. 
Neither test, however, was а test of legal apti- 
tude specifically. 

In 1937 the Law School of the University of 
California adopted the use of a legal aptitude test 
for purposes of selection and а5 а possible pre- 
dictor of success. Dickinson (23) found after а 
period of four years' experimentation that stu- 
dents who scored high on the aptitude test did 
well in the Low School's course program. The 
correlation of the aptitude test with grades in 
the Law School was . 75. 

The development and application of tests for 
selection of students to study engineering have 
had a longer history than either medical or law 
aptitude tests. 

An experiment was undertaken by Hammond 
and Stoddard (42) to discover whether aptitude 
tests were useful as means of predicting proba- 
bility of success in engineering. Тһе correlation 
between composite scores in the entire series 
of English, Physics, Chemistry, and Mathemat- 
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ies Aptitude Tests and general success in the 
work of the freshman year was . 70. 

Sackett (90) reported that aptitude tests in Eng- 
lish and Mathematics were given to nearly 3000 
entering students in twelve colleges. The math- 
ematics aptitude test showed a correlation of .57 
with the average grade at the end of the first year 
and .52 at the end of the second; the English test 
resulted in a correlation with average grades in 
the two years of . 45 and . 37, respectively. It 
Seems safe to say, was the conclusion, that a 
good mathematics test has selective value for en- 
gineering students. 

Bingham (7) in his Engineering study reported 
that the score on the mathematical section of the 
Aptitude Test is one of the most dependable meas- 
ures for predicting engineering success. 

Wilson and Hodges (117) found that marks in 
freshman mathematics and freshman mechanical 
drawing courses correlated . 42 and . 406, respec- 
tively, with marks in engineering courses and 
the Aptitude Test. With the same criterion, the 
Otis Advanced Intelligence Scale correlated .382. 
A multiple correlation of . 69 for marks in ad- 
vanced courses in engineering was obtained with 
marks in freshman courses, and scores on the 
Otis test. Intelligence tests, previous scholar- 
Ship, scores on special aptitudes, and achieve- 
ment tests in science and mathematics seem to 
provide the best combination for prediction in 
engineering. 

Ruch (88) suggested that the best measures 
for selection and prediction of Students for teach- 
er-training institutions are batteries of tests of 
general intelligence ability, reading tests, and 
personality tests. The correlation between the 
intelligence test and grades for one Semester 
was reported at . 80; the correlation between 
reading test and academic grades was . 75; ала 
the correlation between the personality test and 
grades of special college tests was . 72. 

Roberts (86) found that the Army Alpha Intell- 
igence Test correlated . 75 with the students’ ау- 
erage of the first and second semester's grades, 
Roberts found that success in college is determ- 
ined by mental ability. 

This review of related literature seems to 
have shown the value of research with this prob- 
lem of selection and prediction of success of col- 
lege students as measured by selected criteria. 
It also seems to indicate that these studies have 

made many contributions to the problems of vo- 
cational success, It would seem highly desirable 
to conduct continued studies with these matters 
of selection, prediction, and success. 
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SECTION II 


OPPORTUNITIES AND REQUIREMENTS OF 
PHYSICAL AND OCCUPATIONAL THER- 
APISTS 


AS A RESULT of World War II, unprec- М 
edented development has taken place іп both phys 
ical and occupational therapy. These two ауе 
ions of physical medicine are purposely referre 
to together, since in modern practice they are 
inseparably interrelated. = 

The causes that have been responsible for rec 
ent progress in physical medicine are the жаг 
with its many physical casualties, a sharp rise 
in industrial accidents due to the large numbers 
employed, and the wide-spread publicity given 
physical medicine along with the stimulus, in the 
form of educational opportunities and material 
assistance, furnished by the National Foundation 
for Infantile Paralysis, the Baruch Committee, 
and similar organizations. As a consequence of 
the above causes, in this country more people 
than ever before have acquired an interest in 
physical therapy and occupational therapy, have 
Sought to take up these callings, and have come 
to look upon them as highly desirable and con- 
Structive forms of occupational endeavor. 

During the cessation of hostilities and the ad^ 
vent of peace, the thought was expressed Бу some 
that there probably would occur a more or less 
sharp decline in the demand for those trained in 
physical medicine. Although the war has long 
Since ended, there is no evidence to indicate 2 
diminishing need for services in physical therapy 
and occupational therapy either in the immediate 
or distant future. For at least another genera- 
tion the problem of rehabilitation of industrial tes 
casualties, war casualties, and other disabill е 
promise to tax our ability to produce enough a! _ 
equately trained physical and occupational ther 1 
apists to meet Ше continuing employment deman 
To be successful with this problem better selec 
tion and training of the students must be made. 


“It is becoming more and more ap- 
parent that physical medicine is ex- 
panding rapidly and that in the future, 
it will encompass a broad and at pres- 
ent considerably neglected phase of 
medical practice. As it is now devel- 
oping, physical medicine is progress“ 
ing into three major fields: (1) phys- 
ical therapy, (2) occupational therapy; 
and (3) reconditioning of the conval- 
escent." (36) 
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Physical Therapists 


me ition; - Є Physical therapy is the treat- 
ight, дон ог injury by means of heat, cold, 
ater, and es massage, therapeutic exercise, 
аге used E ectricity. " (37) The modalities 
Physician 3 reatment which is prescribed by а 
myelitis i such disorders as sprains, polio- 
Physical A sss arthritis, and other cases. 
terestedi erapy offers a career for persons in- 
[Meine tau rehabilitation. 
has been di therapy, like occupational therapy, 
elping rca to be a tremendous aid in 
Or to wie Е for their return to duty 
h S grown bah жесе life. Since World War I, it 
я been prove y and steadily as its usefulness 
цв rial абс; їп Ше сазез of crippled children, 
quem Е eee and infantile paralysis. 
rapists uae war came, the need for physical 
s Outlook, ол considerably. 
й istered with др меге 2000 physical therapists 
100 erapists T e American Registry of Physi- 
"s them mance in 1946. Less than 
- еге п. 
sd therapists d acute shortage of trained phys- 
bein greater а the war and Ше demand is 
e met. Appli the supply. The needs are not 
quan’ мане ications for training are now ex^ 
sity x ed are pe S pea A so that only the best 
fro 9Í Wisconsi ected. This year at the Univer- 
and ог Уніан SL 525 applications were received 
ed Не foreign states and Washington, D. C., 
Ошу 8hrolling „анкета from persons interest- 
мер, Seventy а ees Physical Therapy course. 
апр, „РРЧсагиз of the 525 interested 
ot без. — Worki 
Drege Pati orking always under the direction 


е: , 
ries es trop Sician who diagnoses and then 
ang aS the do en, the physical therapist саг” 
8n te, Sage to. ог'є orders. She applies heat 
Useg T ег or a stimulate circulation and to tough- 
She yee? oss Skin. The physical therapist 
to be Bes кр S and hands іп rapid movements. 
Stigg ах and oe oo! baths and ultra-violet lamps 
Ned ог Fendy exercise muscles which have 
©һа О therapist š lost their power of motion. The 
Е M. inger also employs pulleys, posture 
ampa en then wonders, ladders, «walkers, "' 
О ace ners, exercise machines, and walk 
Young са аны lish her purpose. 
in ац Person =, — What qualifications must a 
ч > Booq eni for success in this field? First 
ique and sympathetic understand- 


i e 
өр ` Capa penis human problems, and yet 
та Patien pud being casual when necessary to 
mu in Should RS any self-pity. A physical 
trast be “ical pÈ ave a keen interest in medicine 
Noles Mterested нео. Besides this, she 
> ive in other people and their 
an intense desire to be of ser- 
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vice to people who are in need. 

The physical therapy technician must have а 
strong interest in her work so that she is con- 
stantly motivated. She must possess mechnanical 
aptitudes, mental ability, judgment, reasoning 
and verbal ability to such à degree that she will 
present herself in a self-reliant and successful 
manner. She must not exhibit any anti-social or 
withdrawing tendencies. The physical therapist 
should possess adequate social standards and 
social skills. 

Training. — Special training is absolutely nec- 
essary. А registered physiotherapist must have 
received her education in one of the 26 schools 
accredited by the American Medical Association. 
A typical course of study is the one offered by 
the University of Wisconsin which is approved 
by the Council of Medical Education, and Hospit- 
als of the American Medical Association, and 
prepares the student to meet the qualifications 
and training for registration in the American Reg- 
istry of Physical Therapy Technicians. 

Degree Course in Physical Therapy’ — This 
is a four-year course leading to the degree of 
Bachelor of Science in the School of Letters and 
Science and a Certificate in Physical Therapy in 
the Medical School. 

For entrance to this course the student must 
satisfy the general admission requirements of 
the University. 

Because of the limitation of clinical facilities, 
at the completion of the sophomore year the high- 
est ranking thirty students will be selected to 
complete the last two years. 

The curriculum requirements are the comple- 
tion of 124 credits and at least 124 grade points. 
On the next page is the recommended sequence of 
the course for the four years and the Certificate 
Course curriculum. 


Certificate Course in Physical Therapy - The 
certificate course for physical therapy technic- 
Тапз is twelve months in length and begins іп бер- 
tember of each year. College credit toward a 
degree in Physical Therapy is given for this work 

Candidates for admission must satisfy one of | 
the following requirements: 

1. A minimum of 60 college (academic) cred- 
its including courses in animal biology and phys- 
ics. 

2. Graduation from an accredited school of 
nursing. 

3. Graduation from an accredited school of 
physical education. 

Courses in chemistry are highly recommend- 
ed. Due to the limitation of clinical facilities 
the number of students admitted to the course is 
limited to twenty. 

Earnings. —Salaries vary considerably, ac- 
cording to the section of the country. A recent 
survey by the American Physiotherapy Associa- 
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Freshmen 
1st Semester 2nd Semester 
Chem ГУ» da... car eres 5 Chemistry 5. 0.24 sockets 5 
Eng SD ИА: лов моя я ж волана 3 English Jb. леер 3 
Language 1а or Language 1b or 
BOGIALSUUdIeS.. „ера neas 4 Social Studies. .............. 4 
PHYSICS банз seio банан 3 PHYSICS брі. esos deve риялық 3 
Phys. Ed. «ытағшасы ыы sassa 0 HHyS 02 асы morti BiU 
1 15 
Sophomore 
lst Semester 2nd Semester 
English or history............ 3 English or history........... 3 
Language 10a or Language 10a or 
Social Studies............., 3 Social Studies.............. 3 
Speech s; ана ант 3 Psychology 1 4 
Әуе» Ea ста Б бананом 0 Phys. Med. l(Orientation)... 1 | 
B. Chem, ША. asocia аа pan 3 РНуб ЕЙ; побороти 0 
ОСН OS ra s эсени s 3 ZoOloBY l...evosscscuiceo eee 5 
1 16 
Junior 
1st Semester 2nd Semester А 
*Physiology 115............. 5 Physiology 116 (Applied 
*Psychology 105 (Human Physiology)................ 3 | 
Аајиѕітепіѕ).............. 3 Speech 126 (Advanced 
*Anatomy 37................ 6 Speech СоггесНоп)......... 3 
Home Ec. 119 (Child Psychology 106 (Abnormal)... 3 1 
Реуе!ортеп().............. 2 Phys. Ed. 56 (Kinesiology)... 3 
БОЙ ВЕСИ УВ: кобра ва sus өтесе 3-4 
16 15-16 
Senior (12 months) 
1st Semester 
*Physical Medicine 2 (Preclinical SUDJECES) sunar pi НАА 1 
*Physical Medicine 3 (Medical du noce S MN милы 4 
*Physical Medicine 4 (Мазваве).. 7 2 
Physical Medicine 100 (Applied anatomy) 3 
*Physical Medicine 101 (Pathology)............ l 2 
Physical Medicine 103 (Journal Си). у 1 
Physiology 117 (Special problems іп physical medicine) 28 
16 
2nd Semester 
*Physical Medicine 5 (Therapeutic ехегсїве)............ ....... 4 
*Physical Medicine 6 (е1їесїгойегару)..........‚ 77777 4 
*Physical Medicine 7 (Нудгошегару). И 1 
*Physical Medicine 8 (Clinical Practice). eene ILE T NN 5 
*Physical Medicine 102 (Ethics and administration)... 77777 1 
*Physical Medicine 103 (JournalClub............,,,,,,, 77777777 1 
ysica е: 


*Denotes courses taken by Certificate group for Ше twelve-months course. 
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lent, h twar future for therapists looks excel- 
Crowde, та therapy has never been оуег- 
(ог various cases U be used increasingly 
live, In ae disadvantages, the therapist must 
Slated in p пу cases, at institutions which are 15- 
uirements aves communities. Educational ге- 
аі the бы constantly being increased, 50 
lis Some е of getting Ше necessary training 
m to Work a disadvantage. Therapists often 
uU them 4 ib шаша! and physical cases which 
uM len difficult situations, and as a result, 
high con nstant nervous strain. Salariesare 
Sidering the training required. 
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in the use of this type of treatment for mental 
patients, crippled children, tubercular patients 
and convalescents, opportunities will continue to 
be good. 

Duties. —‘‘Occupational therapy is expanding 
rapidly and seems to be breaking away from its 
preoccupation with arts and crafts and to be ех- 
tending into a wider field including new prevoca- 
tional, avocational, and vocational pursuits. The 
occupational therapist today is concerned with 
skills and techniques such as creative arts, recre- 
ation and educational subjects. ”” (76) 

The occupational therapist must know handi- 
craíts, medicine, and psychology. For each 
person she must know something of his cultural 
background, previous interests, and hobbies. 

She assigns work or projects that will be benefic- 
ial, grading it to match the patient's progress 
and his increasing strength and dexterity. She 
then measures the results and keeps a chart of 
the patient's recovery. 

The occupational therapist works with mental 
or orthopedic patients. Some therapists аге em- 
ployed in tuberculosis or children's hospitals or 
wards. Still others specialize in work with the 
blind or with patients who are chronically ill. 
The occupational therapist engages in embroid- 
ering, knitting, and basket-making, things in 
which most women find pleasure. The therapist 
has such duties as carpentry work, hammering, 
sawing, painting, whittling, drilling, printing, 
modeling, crocheting, and making leather goods. 
She must keep records and provide educational, 
dramatic, music, and dancing programs. 

Qualifications. —''In order to do her job well, 
the therapist must have certain qualifications. 
She should have good health, and excellent men- 
tal and emotional selí-control. The therapist 
should possess the ability to be casual, with no 
false cheering up and no overpraise, yet with no 
minimizing of patient's progress. Extreme pa- 
tience with cross or fretful individuals, with the 
mentally ill, and with naughty children is vital." 
(16) 

The occupational therapist must like people 
and genuinely desire to help them. Tact, poise 
a well-balanced personality, initiative to find ' 
activities that will awaken a response, and a 
sense of humor are allessential, as is an inter- 
est in medicine and scientific subjects. 

The therapist should possess manual dexter- 
ity, physical and emotional health, muscle coor- 
dination, and special attitudes needed for her 
work. р 

Training. — Special training is absolutely nec- 
essary. А registered occupational therapist must 
have received her education in one of the 25 schools 
accredited by the American Medical Association 

The University of Wisconsin is one of the | 
schools offering а four-year academic course 
leading to the degree of Bachelor of Science in 
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Occupational Therapy which is followed by thirty- 
Six weeks of hospital experience in the practice 
of occupational therapy under the Supervision of 
registered occupational therapists. On success- 
fully completing the course, students receive a 
certificate from the Medical School as graduate 
occupational therapists. 

During their four years of academic work 
students are enrolled in the School of Education 
and concentrate on social and biological sciences 
together with technical courses in the arts anda 
variety of manual skills to supply the background 
required for their clinical work. 

For entrance to this course a student m ust 
Satisfy the general admission requirements of 
the University. The course is under the joint 
control of the Schools of Education and Medicine. 

The curriculum requirements are the comple- 
tion of 124 credits and at least 124 grade points. 

On the next page is the recommended sequence 
for the course in Occupational Therapy. 


Earnings. —Salaries for beginners range from 
$2800 to $3600 a year. After the occupational 
therapist has gained experience, she can expect 
to earn from $3600 to $5000 a year. In the ex- 
ecutive positions, the Salary range is $6000 to 
$8000 per year. CivilService therapists receive 


le, the salary situ- 
rewards, however, 
B but are in the emotion- 
disabilities, ` of helping people overcome their 
Advant Без and Disadvantages, — The advant- 
ages and disadvantages for the Occupational ther- 
apist are practically the Same as for the physical 
therapist. There is more Opportunity for men 

in occupational therapy, for the new trend in re- 
habilitation, a trend which requires that the oc- 
cupational therapist be able to teach metal trades 
woodwork, carpentry, etc. » tomen patients, шау 
result in ап increase in the demand for male ther- 
apists. 

й Тһе lack of training facilities for male 
students plus the fact that Salaries, while 
they are considered fairly good for women, are 
rather inadequate for а man to raise а family on, 
makes the field a difficult one for them: 

The opportunities and requirements in phys- 
ical and occupational therapy are practically sim- 
ilar. There is a great demand today for both | 
types of therapists, and Бош divisions of physi- 
cal medicine are expanding rapidly. Since World 
War I much more training is required of trainees 
in physical and occupational therapy. ш 
pre-professional and personal qualifications are 
necessary for the students in therapy tra ing. 
Salaries for the graduate therapists ar os ^ cham 
what attractive and their future is pec ан 

is а need for therapists which will exis for 5 
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time. The advantages for the physical and occu- 
pational therapist overweigh the disadvantages. 


SEC TION III 
METHODS AND MATERIALS OF INVESTIGATION 
A. Methods of Investigation 


FOLLOWING a careful survey of available 
information from published reports and referen- 
ces, the data presented in this study were Неси 
ед on the University of Wisconsin campus by us 
ing a battery of tests, а rating scale, а data form, 
and other information gathered from the subjects 
and the Registrar's office. The University ӨШ 
dent Counseling Center also cooperated by furn 
ishing some Supplementary data which were not 
available in the Registrar's office. 

The survey of literature included books and 
pamphlets listed in the Education Index, the ibe 
Reader's Guide to Periodical Literature, and n 
liographies secured from various books and зе й 
ected references from the American Medical ы 
Sociation, National Education Association, ап 
Encyclopedia of Educational Research. 

An especially helpful selective bibliography 
on Physical Medicine was obtained from Miss 
Caroline G. Thompson and Miss Margaret A- 
Kohli, Technical Directors of the Departments 
of Occupational Therapy and Physical Therapy: 
respectively. Е 

In this investigation а battery of twelve car г 
fully selected tests covering six areas of desir al 
information was administered to the 234 phy See 
therapy and occupational therapy students. a 
kinds of tests were used in this battery, пае у 
the paper and pencil type, and the performanc " 
type. The former was administered to gro ea й 
апа the latter was given to Ше students indivi 
ally. 

The rating scale used in this research prady 
was constructed by the Department of Physica e 
Medicine. This instrument is a five-point зса 
which has three categories: professional pre КЕ 
Paredness, professional qualifications, and ed 
Sonal qualifications. Five instructors in P pt 
Cal Therapy, as well as five instructors in OC ts. 
pational Therapy rated their respective studen 
The ratings of the five instructors were cher 
pooled and an average for each quality or tr a 
was submitted from the five ratings. This was 
done for both Occupational and Physical Ther? 
pists. was 

The two-page data form used in this studY 25 
constructed by the author. The information and- 
gathered from each student during a short 512 
ardized interview and the results were recor 
in the data form during each interview. 
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Freshmen 


1st Semester 


English 1a (Freshman 


English). еее» ез 3 
Foreign Language 1а........ 4 
Art Ed. 50 (Freehand 

Draw. Регврес.)........... 3 
Physics 65 or 1............. 3-5 
P. E. 15a (First Aid) H 


2nd Semester 


English 1b (Freshman 


English)....... enn 3 
Foreign Language 1Ъ......... 4 
Art Ed. 51 (Freehand 

Пгаміпе).................. 3 
Zoology 17 ог 1............: 3-5 


О.Т. 1 (Preclinical Train.).. 1 


Physical Едчсайоп.........-- 0 p. E. 48 (Recreational 
Therapy)..... «ttum 1-2 
15-16 
Sophomore 
1st Semester 2nd Semester 
Foreign Language 10а........ 3 Foreign Language 105.«-«4<-> 3 
Art Ed. 62 (Creative Art Ed. 62 (Creative 
Design)....... Ie 3 Design)...... mme 3 
Art Ed. 54 (Elem. Physiology 3.....------- “<< - 4 
Modeling). нее" 2. Anatomy 36..... «nn * 6 
Speech 1.............. nnn 2 Phy. Education....« nnns 40 
Sociology 1....5..-..---4 я» 3 16 
ЕІесіиуев..................?. 3 
Phy. Едисайоп............--. 20 
16 
Junior 
1st Semester 2nd Semester 
Art Ed. 70 (Art Мейг1)....... 3 Art Ed. 71 (Ройегу).......... 3 
Psychology 1 (Introd. )....---- 4 Art Ed. 175 (Crafts for 
О. T. 2 (Medical Lectures). . 1 QUE, Jes лава на 4 
Home Ес. 85 (У/еауїпр)........ 3 p. E. 56 (Кіпевіоіору)........ 3 
Electives..... eise 5 Home Ec. 94 (Dec. 
16 Textiles)... + 2 
Ейесіуев.........4 9999... 24 
16 
Senior 


1st Semester 


Psychology 105 (Human 


Adjustments). .. -< s 3 
O. T. 3 (Surgical Lectures)... - 1 
O. T. 4 (Practical Applica- 

tion of О.Т. сгаНв)........?. 2 
Home Ec. 119 (Child De- 

уейортепі)......- 000 2 
Home Ес.15.........- ы 2 
Electives..... ett 6 

16 


2nd Semester 


Psychology 106 (Abnormal)... 3 


O. T. 5 (Theory of O. T. | ч 4 
O. T. 6 (Clinical Prac. 
and Dir. Teach. ........... 1 


О. T. 7 (Neurology, psychi- 
atry, communicable 


diseases)....... nnn nn 3 
p. E. 176 (Therapeutics). ..--- 2 
Electives..... ntm 3 

16 
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The data form included items of general infor- 
mation such as name of student, age, sex, year 
in School and course, race, descent, degrees 
held, birth data, and the other data. 

The data form also included a psychograph of 
all the tests. This test profile contained the 
names of the tests administered, the raw scores, 
and the percentile ranks on all tests taken. 

The data from the Registrar's office included 
the actual grade point average, predicted grade 
point average, high school rank, and general in- 
formation concerning the subjects. 


B. Testing Program 


It was found that the testing program needed 
for this study required a selection of measures 
for intelligence, interest, special aptitudes, reas- 
soning and judgment, achievement, and person- 
ality. The particular combination of measuring 
techniques required in this investigation was dic- 
tated by the specific purposes to be Served by the 
various tests. 

It is necessary that a Systematic business- 
like procedure be employed by the group incharge 
when the purpose of the testing program is estab- 
lished. This also holds true for the selection of 
the tests. In selecting the battery of tests the 
committee scrutinized the pertinent literature, 
the actual blanks, and the corresponding manuals 
relating to all materials under consideration. The 
committee members, each independent of the 
others, looked over these materials for the pur- 
pose of considering the following data: 


1. Title, author, 
2. Significance, 
3. Validity. Does it measure what it purports 

to measure? 

4. Reliability. How accurately and consistently 
does the test measure? 

5. Diagnostic value. Does the test give infor- 
mation as to the trainee's difficulties? 

6. Norms. What types are available? Are they 
representative? What is their range? 

7. Administration. Is the test easy to give and 
score? How much time is required? 

8. Pupil Performance. What does the pupil do? 
What dimensions (speed, difficulty, quality) 
are measured? How are the scores 

ressed? Р 

9. @опайтибНдп of the test. How were the items 
selected? How was the placing of the items 

ied out? 

10. Manual. Does it contain complete and d 
ily intelligible directions? Does itgive ae : 
Does it suggest uses to which the test үа 5 
might be put? Does it give data about Ше 
test? 


publisher, designated function. 
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11. Costs. The cost was considered in relation 
to the dependability and usefulness of the re 
sults. 

12. Mechanical considerations. What are the 
good and bad points about the typography, als 
makeup, packing, size and complexity of 
test, material (wooden, paper, cardboard) 
of the test, etc. * 


“‘Tests have two major functions: а SE ы 
ination of the needs, abilities, achievement gd 
us, interests, intelligence, and personality с е 
acteristics;.and an appraisal of the outcomes o 
learning. ” (18) 


Objectives of Testing Program 


Е іп 
The information the committee desired p^ am 
from these tests is found in the answers to t 
following questions: 


2 

1. What mental ability does each кое ева 

2. Does the student possess the ability to ше 
orize verbal and visual materials? 

3. What are the student's interests? 

4. To what extent does each student's memory, _ 
mental maturity, judgment, reasoning, ver 
al, and performance abilities limit her? Bf 

9. What ability does the trainee have to use 2? 
hands and fingers skillfully and dextrously 

6. What ability does the student have to train 
her muscular movements? ills 

7. Does the student use her abilities and ski 
in a self-reliant and successful manner? is 

8. What ability does she have to visualize ра ity 
terns and relationships without the necessi" 
of preparing drawings of all these genna c 
Ships? Associated with this is the objec í 
of measuring the student's appreciation O 
artistic design. 


an^ 
9. What is the student's knowledge of word me 


2 
ings—both general and scientific vocabulary 
10. What is the student’s ability to read with will 
derstanding the type of material that she ? At 
be expected to read in Physical Medicine 
what rate will she read this? is 
11. Does she possess social maturation? Thi 


is associated with practical judgment. 
12. How is her personality? 


a. Does she exhibit any anti-social or with 
drawing tendencies? m 

b. What deviations, if any, does she poss 
ess from the normal personality? de 

с. Does she possess adequate social stan 
ards and social Skills? 

d. Is she maladjusted? 


š Я а 
The emphasis оп aptitudes, interests, ап 
personality measures is necessary since the 


" f Education, University of Wisconsin, 19Щ7. 
7. М. Rothney, Department о. 3 е 
i d paper by John We 
#Unpublishe' 


| 
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mrs of students have had little or no exper- 

ing the ке work of any sort prior to enter- 
The co ysical Medicine program. 

he tests Ge Se after а careful selection of 

tions or — E them into six classifica- 

Оп are as follows: e areas and tests decided up 


Intelli 
igence: The Wechsler-Bellevue Intelligence 
Scale and the California Mental Ma- 
turity Test 
Achiey 
ement: The Wide Range Achievement Test 
and the Michigan Speed of Reading 
Test 
Intere 
St: 
^ The Kuder Preference Record 
Ptitudes: š 
es: The Purdue Pegboard, The Minne- 
Sota Rate of Manipulation, The 
Minnesota Paper Form Board, and 
the Bennett Mechanical Compre- 
З hension Test 
*rSOnali А 
ity: Тһе Minnesota Multiphasic Рег- 
Sonality Inventory, and the Wash- 
я burne Social Adjustment Inventory 
Tactical 
“dgment; 


The Cardall Practical Judgment 
Test 
The с . 
1 цев prom = recognized that some of these 
qui tha reason remely difficult to measure and 
be wed before 2 considerable time may bere- 
ще Signed а adequate measuring devices сап 
ho ntal ы developed for them. Тһе funda- 
ces Ver, is НА of this aptitude testing program, 
хеде ikely i extent to which the therapy stu- 
te. lon and | зиссеед іп һег professional prep- 
3ts to be ater employment. Therefore, the 
Cup, Se cnt. were expected to indicate some 
stationa] ae success in the practice of oc- 
над Prévio physical therapy. Of course, as 
as these - m nowhere is the claim made 
eni, © Only i other aptitude tests can be used 
Be О the riterion for the admission of stud- 
test оге and Spartment of Physical Medicine. 
Ñive, бо after the committee selected its 
the П to the nsideration and discussion were 
tiy Peas of ene purposes to be served by 
Š [ я test battery. Significant objec- 
Whig discuss areas and reasons for their use 
ча, they ed in connection with the services 
щ render in diagnosi appraising, and 
ere 8. The ar gnosing, app E 
^ tha °MSidereg os of the battery of tests which 
6 Attain red relative to their effectiveness 
egt tel Ped of the objectives established 
tia] tests tests, achievement tests, 107 
adjust pecial aptitudes, personality and 
ment tests, and judgment and reas- 


Sr 
tex еі 


So 
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oning tests. 
A discussion of the prime considerations and 
salient functions of each of these areas follows. 


Intelligence Tests 


“Тһе exact nature of the combination of abil- 
ities known as intelligence is not well understood. 
However, it is definitely known that individuals 
differ widely in the amount, andperhaps the qual- 
ity, of it they possess, and that within limits it 
can be measured. ” (38) 

Many definitions of intelligence have been giv- 
en. Two of the definitions most commonly quot- 
ed are: 


Binet: 


‘Intelligence is the tendency of thought 
to take and maintain a definite direction, 
the capacity to make adaptations for the 
purpose of attaining the desired end, and 
the power of self-criticism. "" (38) 


Henmon: 


“Intelligence involves two factors — 
the capacity for knowledge and knowl- 
edge possessed. ”’ (38) 


There are two types of general intelligence 
tests, the group and the individual types. Indiv- 
idual intelligence examinations constitute the most 
accurate devices for the measurement of intelli- 
gence. Individual intelligence tests are pattern- 
ed upon the Binet-Simon tests brought out in 
France from 1905 to 1911. The Wechsler-Belle- 
vue is rated one of the best of its type today. 

Group intelligence tests originated in America 
during the First World War. The Army A lpha 
and the Army Beta tests, the latter really a per- 
formance scale, Were developed for use in selec- 
ting personnel for officers’ training and (ог other 
positions requiring high intelligence. 

One of the best group intelligence tests is the 
California Test of Mental Maturity. Mentalages 
and intelligence quotients can be obtained separ- 
ately for the language and non-language sections 
and for the instrument as а whole. 

The intelligence and mental maturity tests 
bring out the individual's language and non-lang- 
uage abilities. They also indicate the stage of de- 
velopment of such mental processes as memory 
reasoning, vocabulary, and spatial relationships 
These tests should be interpreted in the light of k 
the individual's background, environment, and 
training. Š 

Clinical examiners who are relativ "- 
fied with some form of the снить А 
welcome а test, like Ше Wechsler-Bellevue, whic! 
is intrinsically better adapted to adult на НЕ 
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and which is adequately standardized for adults. 
Achievement Tests 


This type of testing is probably the most 
straightforward and easily understandable type. 
The range of achievement measures is and should 
be greater than a classroom examination. 


“We are familiar with the average 
grade and the specific pattern of an in- 
dividual's grades, from which we can 
judge him to be best in one subject and 
poorest in another, or better in one 
type of subject than he is in another. 
These are important measures for in- 
tra-individual and inter-individual an- 
alysis, so long as we have all our indi- 
viduals within one School. But when 
Students move outside the walls, our 
grades are not always such 5004 meas- 
ures and not always the only measures 
predictive of the later adjustment of 
individuals, > (11) 


Few PSychological Studies are complete with- 
out school achivement tests. Recent Clinical ex- 
periences indicate that a thorough examination 
of а person's personality should include not only 
interest and intelligence tests, but also tests of 


ly positive, but not as high as was believed twen- 
іу years ago. This finding is consistent with the 
view that failure in School and in lif 
may be caused by many factors besides lack of 
intelligence. Thus it happens that a child of av- 


come relatively proficient in both reading ang 
arithmetic. 

The Wide Range Achievement is a fine diag- 
nostic measure and it is very revealing in the 
study of individuals. 

А need for more reliable tests for speed of 
reading has been felt both in researches concern- 
ing the legibility of type and Studies of the im- 
provement of reading ability. Reading disability 
is practically always a deficiency in the mastery 
of mechanics and not of comprehension. The 
Michigan Speed of Reading Test clearly points | 
this ош. This is one ої the primary reasons this 


test was selected. 
Interest Tests 


Interest has long been considered a po ый 
successful adjustment in М. з рое. 
iet à Ely 
sibility that interests adequa à 
а of some prognostic value has resulted іп much 
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experimental work on this problem. Various 
methods have been used for discovering interests. 
The easiest and most common procedure, and 
most unsatisfactory, is to ask individuals what 
they are interested in. This method is extreme- 
ly inaccurate both Írom the point of view of re- 
call and the inability to express desire in words. 


Attempts to develop objective measures of inter- 


ests have resulted in several effective techniques. 
Of these the most valuable are the questionnaires 
Or interest inventories, ; 
Kuder (55) and others studied the constellation 
of interest because it had been demonstrated that 
опе interest isolated from other factors is not 
reliable for prediction or Success or valuable for 
guidance. Тһе Kuder Preference Record mn 
tended for use in Obtaining measures of motiva i 
tion in various lines of study and of work through 
а systematic record of a variety of activities. 
The preliminary studies disclosed a marked 
relation between patterns of Scores and occupa- 
tional choice. More recent research by Traxler 
and McCa11 (108) and Yum (120) bolsters these 
Conclusions, Traxler and McCall found that the 


dictive value; and that there were noteworthy sex 
differences, 


Special Aptitudes 


“Aptitudes may be defined as poten- 
tialities which can be trained into spec- 
ial skills useful in later job adjustments. 
For example, clerical aptitude may be 
the Potentiality which could be trained 
into bookkeeping or accounting or filing 
Skills. Mechanical aptitude might under 
training become proficiency or skill in 
punch press Operation, welding, and 
other mechanical trades.’ (т) 


“Ап aptitude is the Condition or set 
of characteristics regarded as symp- 
tomatic of an individual’s ability to 
acquire with training some Specified 
knowledge, Skill, or set of responses 
Such as the ability to produce music, 
etc. » (85) 


Aptitudes may һе either acquired or inherited 
Present traits” of the individual include not 

only his ability also his interests, adjustments, 
Character, physical aspects, and all his other 
but in evaluating his special aptitudes , 
We usually concentrate on the one, two, three € 
more aspects which are most valuable for pre 
dicting success, м. 

Aptitudes аге Similar to other aspects of in 
dividuals in that they are not all equally strong 


пя» 
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don бие same person, and in that people differ 
ion of another with respect to their possess- 
Lik у single aptitude. 

г. general mental ability, aptitudes may be 
ar с to be relatively stable. It is often 

of enga nies] to fit an individual's field 

iS presa P either educational or vocational, to 

change zi Set of aptitudes than to attempt to 

ing so нат aptitudes through some kind of train- 
Savor, 9 enable success in some field of en- 

e ТЫЗ doe not mean that in evaluating aptitudes 

Вауе not oe for aspects of the student which 

ing, eg influenced by experience and train- 

jected to 15, even aspects that have been sub- 

Present i training—in other words, the 

Svaluateq ^ievements of the students—should be 

Considered 50аг as these achievements may be 

In deal; predictive of future achievement. 

ary to о With special aptitudes it is necess- 

Cupations ermine the degree to which various ос- 
ерт ір require each of the aptitudes, then to 

Se е the degree to which an individual pos- 

of the primary aptitudes, and finally 


to Fo each 
doge, : 
"mine the individual’s fitness for the oc- 


“Upation, 


he 

brea Би traditional approach makes Ше 
ВСВ аз " first in terms of fields of endeavor 
Чопа ua? art, engineering, law, occupa- 
речен б physical therapy, and then соп- 
at Predict ите instruments specifically for 
t hat is ie s of success in each of these fields. 
x help dn E Construction of most tests designed 
(Qn wilt pe Stimating the probabilities that а per- 
cae Or Brote ае to follow successfully an occupa- 
а top е5510п she is considering has attempt- 
а, АПУ det down mental ability in terms of cul- 
ithe aPtitug mined fields, e.g., musical aptitudes, 
the ез, wass Verbal aptitudes, mathematical apt- 
aye, APtitug Sing aptitudes, legal aptitudes, teach- 
Btitudes “з, engineering aptitudes, mechanical 
melt is во Clerical aptitudes, and the like. 

stud Sure abetimes necessary and advisable to 

Sent in Ptitudes directly instead of placing the 
thi t is ES а Competitive where the end achieve- 
tot reason d as an index of original aptitude. For 
Wh? Popul the committee recommended that the 
по wi аа be tested with the aptitude tests 
ре теср ОЦУ in this discussion. There are 
5; nical aptitude tests than any other 


Топ А 
ality and Social Adjustment Tests 


а: Atte 
ы, “hara to judge and predict general person- 
Dro tke pe; гг, ог the ability of the individual 
за enbly zi; AL and social adjustments, are 
аы, Var acte numerous than for any other hum- 
У sei по ЗзНев ог area of living. Unfortun- 
Ces contributions have not been very 
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Íruitful in this area. Within recent years, there 
has been much interest in the measures of per- 
sonality and social adjustment. Тһе results give 
some promise from the standpoint of prognosis 
and gradually these tests мій be thoroughly 
enough tested to be used in individual prediction. 
Great care needs to be taken in applying any such 
measures. The interpretations can be made only 
by individuals adequately trained. 

Paper-and-pencil and performance tests have 
appeared in great numbers. 

Personality and adjustment inventories range 
from attempts to measure such personality traits 
as feelings of inferiority, schizoid characteris- 
tics, attitudes toward family, life, and school, 
neurasthenia, etc. 

Generally speaking, there are four standard 
methods of measuring or evaluating personality 
characteristics and personality adjustment: 


1. Rating scale on which outside observers rate 
the student's possession of personality traits. 

2. Intensive interviewing in which skilled work- 
ers (psychologists, psychiatrists, socialwork- 
ers, clinical workers) use the interview as а 
tool to probe the personal adjustments and 
personality characteristics of an individual. 

3. Anecdotal records or behavior journal which 
represent fruitful information for measuring 
or estimating personality. 

4. Paper-and-pencil tests of personality which 
student fills out himself. 


The scores on a personality test can usually 
be considered to tell only that a maladjustment 
does exist, or the general area of the maladjust- 
ment, rather than what the maladjustment is. 
Since there are no right or wrong answers in a 
personality test the interpretation of personality 
test scores becomes a matter of importance. The 
highest score need not necessarily be the best 
score ог the best adjusted student may be the one 
who makes about an average Score on a personal- 
ity test. The counselors or clinician should study 
carefully the manual of interpretations which ac- 
companies the personality test. 

Today one of the reasons for sometimes being 
hesitant about adopting or accepting psychological 
tests is that we often think of tests in terms of in- 
telligence, aptitude, and dexterity, andthese fonts 
do not, of course, take into account the more 
general personality traits of the individual. An 
individual might be very high in mental ability 
and possess strong aptitudes and interests чыр 
yethave apersonality that would not only make 
him unfitted for the occupation for which he is in- 
terested but would also make him а definitely un- 
desirable individual to employ in any capacity. 
Ваа personality characteristics and maladjust- 
ment can make it difficult for anyone to work on 
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any job. It is for this reason that personality 
tests and scales are being developed and used to 
measure incipient personality maladjustments 
and temperament traits. In this study two reli- 
able and valid personality measures were used, 
the Minnesota Multiphasic Personality Inventory 
and the Washburne Social Adjustment Inventory. 


Judgment and Reasoning Tests 


Under reasoning and judgment tests are in- 
cluded tests of inference and of problem Solving. 
In inference tests the Subject is asked either to 
detect inconsistencies or to make inferences of 
his own. Greene (35) герогів that one of the bet- 


is usually a judgment of true, false, or undeter- 
mined relationship. 

What is practical judgment? This question 
was asked of a number of psychologists and guid- 
ance personnel. The inquiry resulted in the con- 


portance in therapy work, 

The twelve tests (covering the six a 
sired information) included in this batt 
scribed and discussed in the following Pages, 


Тһе Wechsler-Bellevue Intelligence Scale 
i ее еуце Intelligence Scale 


Author: David Wechsler 
Purpose: 


The primary purpose of this test is to givea 
valid and reliable measure of the Subject’s glob- 
al intellectual capacity and to gather data regard- 
ing the testee’s mode of reaction, his special abil- 
ities or disabilities, and some indications of his 
personality traits. 


Description: 


This one-hour test is administered individual- 
ly. The most obviously useful feature of the 
Wechsler -Bellevue Scales is their division into 
a verbal and performance part. Its a priori val- 
ue is that it makes possible a comparison between 


(Vol. 25 


a subject’s facility in using words and symbols 
and his ability to manipulate objects, and to per- 
ceive visual patterns. It yields a measure of 
general intelligence that may be expressed in 
terms of mental age and intelligence quotient. 

The verbal parts of the test are general infor- 
mation, general comprehension, arithmetical 
reasoning, digits forward and backward, simil- 
arities, and the vocabulary test. The five per- E 
formance, or non-verbal parts, are picture com 
pletion, picture arrangement, object assembly, 
block design, and the digit symbol test. There- 
fore, the Bellevue Intelligence Examination con- 
Sists of eleven tests, six of which are described 
ав verbal and five аз non-verbal, or performance. 
Wherever it is practicable it is desirable to give 
the Full Scale, The vocabulary test is an alter- 
nate scale, 

The information test requires knowledge which 
опе picks up in everyday life as well as in school 
апа in pursuing Cultural interests, The total in- 
formation Score and inspection of single items 
will tell Something of the Subject’s endowment, 


educational and cultural opportunities, and inter- 
ests, 


Subject’s soundness of judgment, that is, of his 


The arithmetic test involves voluntary concen" 
tration. The test involves a focusing of conscious 
ness upon a problem, 5- 

The digit Span test is considered to be a meas 

of efficiency of attention, of the degree of 
freedom of receptivity. ре 

The similarities test gives a measure of ver?" 
al concept formation. It is a test where the sub 
Ject has to describe in what way various pairs 
of named objects are alike. n 

The vocabulary test is helpful in estimating | 
the original endowment of the subject and there 
by detecting impairments in other functions. —— 

, The picture com letion test (in which a m 
те part in each series of pictures is to be poin! 
за out) requires utilization of knowledge and in 
volves voluntary concentration, 


it from its parts, 
The block des 
have to be duplic: 


x 


| 
| 
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қ E digit symbol test in which, according to 

to be hne pie, numbered empty squares have 
ers 12 od by symbols corresponding to the num- 

3 15 closely related to the block design and ob- 


ec 
19 assembly tests. It measures the ability to 
Produce a pattern, 


Norms; 


Di 
yea ifferent age norms for all ages from 7 to 70 
ca 


sn have been established on a total of 3499 


Scoring: 


Succ 
Content 
means 


сен ог Ше raw score with each type of 
du translated into weighted scores. By 
e oos тары these weighted scores can singly 
tient and ка Mental Age and Intelligence Quo- 

for the y, 1 into percentile values. This is done 
аз for th, erbal and Performance Scales, as well 
оттар е Full Scale (Verbal score plus the Per- 

nce Score). 


Validi 
1ЧЦу ang Reliability: 


А соваў 
Bellevue c ational study between the Wechsler- 
by the ta cales’ I, Q.'s and the I. 0.75 obtained 
"анор teford-Binet Test was made. The cor- 
8 about rt 75 cases (ages 14-16) was . 82. This 
пещ en 5 high as most other accepted tests of 
Sults s iie Correlate with each other. Тһе ге- 
measur ie the Wechsler-Bellevue Scales 
Balinsk Out the same thing as Binet. 
chi Ving кд Israel, and Wechsler (3) found Ше 

ав 9rrelations: Bellevue I. Q.'s with Psy- 
(84) 7 Qs a commendation, r=.70, and Belle- 
19) report ith the Stanford-Binet, .79. Rabin 

Slle ейа correlation of . 74 of the Wechsler- 


8 че 
Te (118) у Scale and the Army Alpha. Wolf- 
Sst with 909 ап. 81 correlation of the Bellevue 


i ° Henmon- ination 

it е гецаь: 1: n-Nelson Examination. : 

api , piability coefficient of Information, Dig- 

ra, inst Co "re Completion, and Block Design 

iat ™Prehension, Arithmetic, Picture Аг- 

се ity or ала Digit Symbol was .90. Тһе ге- 
59.5 те Е I. 0.75 against the Perform 


бу, 
Шок; 
Ма Test of Mental Maturity—Advan- 


Authors. Sed Series 
| |: T. Sullivan, W. W. Clark, Е. W. 
EN legs | 
Pose, 
qe tts 


;Snt. Prim 
Чы diagnos Purpose is to make for each stu" 
Which о evaluation of those mental abil- 
ге related to, or determine, her suc- 
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cess in various types of school activity, in order 
that the teacher, counselor, and school adminis- 
trator may utilize this information directly in 
aiding students. The test provides a diagnostic 
profile designed to show graphically the relative 
extent to which each student possesses these abil- 
ities, thus the counselor may provide to the max- 
imum the guidance which such a profile may sug- 
gest. 

The test is designed to be diagnostic and апа1- 
ytical and yields three mental ages—a non-lang- 
uage mental age and intelligence quotient, a lang- 
uage M. A. and I. Q., and the mental age and in- 
telligence quotient characteristics of the familiar 
intelligence test. 


Description of Tests: 


These tests use language and non-language 
Situations in testing memory and attention, orien- 
tation in spatial relations, reasoning abilities and 
vocabulary. Tests of visual acuity, auditory ac- 
uity, and motor coordination are given, but serve 
merely as pre-tests. 

The four tests and their component parts are: 


A. Memory 
1. Immediate Recall 
2. Delayed Recall 


B. Spatial Relationships 
1. Sensing right and left 
2. Manipulation of areas 
3. Foresight in spatial situations 


C. Reasoning 

. Opposites 

. Similarities 
Analogies 

Number Series 
Numerical Quantity 
. Numerical Quality 
. Inference 


о олњ о м н 


р. Уосаршагу 


«Each test is built upon a plan which (1) takes 
into recognized mental processes or functions, 
and (2) corresponds with present knowledge of 
the nature of mental growth and development, ›› 


Reliability: 


«Needless to say, the number and variety of 
test situations assures a high reliability. The 
test data for 600 pupils in grades 7 to 12 have 
been analyzed and reliability coefficients have 
been computed by the split-halves method aid 
corrected by the Spearman-Brown formula. c 
reliability of the Total Mental Factors Score is 
.96; Language Factors, .95; Non-Language Fac- 
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tors, .93; Memory, .92; Spatial Relations, .88; 
Reasoning, . 90; and Vocabulary is . 94. " (12) 


Validity: 


The validity of this test, like any mental test, 
is difficult to establish. ‘‘There are no purely 
objective criteria or standards which correspond 
to the factors or abilities in terms of which con- 
ceptions of mentality are currently discussed. 
The traditional method of correlating the results 
of this battery with the averages of several other 
intelligence tests reveals that the Total Mental 
Factors I. Q.'s obtained with this test may be used 
for comparative purposes with other intelligence 
tests. Further evidence of validity must await 
further knowledge of the nature of mental matur- 
ity." (12) 


Norms: 


The norms are comparable to those regularly 
obtained by use of individual psychological exam- 
inations and well-standardized group tests. The 


norms were established on 600 students in grades 
7 to 12. 


Wide Range Achievement Te sts 
——— st пейешеш Tests 
Authors: Joseph Jastak and Sidney Bijou 


This test measures Separately oral reading, 
spelling, and arithmetical computation. It is de- 
signed for clinical, remedial and vocational stud- 
ies of individual children and adults. The appli- 
cation of the Wide Range Achievement Tests re- 
quires no specialized training. If the Manual of 
Directions is carefully studied and the directions 
are faithfully observed, the tests may be accur- 
ately administered. A discussion of the three 
parts of the four-page test follows. 


Reading: 


This part of the test contains 120 words which 
are pronounced by the student to the examiner. 
The subject reads the words across the page, 
The first clear-cut response Should always be 
accepted and scored as either right or wrong. 
The raw score is the number of words correctly 
pronounced. 


Reliability and Validity: 


The test is one of the most reliable and valid 
tests of reading as a motor skill. Besides, X 
administration and scoring hardly Бати 
than five minutes. Its correlation wit е 22 
Stanford Paragraph Reading Test is а ES to 
with the New Stanford Word Reading Tes . 84. 
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This is based on 389 cases. The reliability co- 
efficient determined by repeated testing was .95 
(110 cases). 


Norms: 


Grade ratings, mental age equivalents and 
test quotients are based on Terman-Merrill's 
table of I. Q.'s which are listed in the table of the 
manual. The norms are based on 1492 students 
Írom first grade up to the senior year in college. 


Spelling: 


The first page of the test blank is reserved 
for the spelling test. Three columns of 23 lines 
each furnish room for 69 words. Since the read- 
ing test is given first, its grade rating servesas 
а convenient clue to the spelling range to be ad- 
ministered. The words are dictated individually 
to the subject and he, in turn, writes each word 
оп the blank reserved for the words. The test 
may begin with a word about two or three grade 
levels below the subject's reading grade. The 
dictation is discontinued on reaching the tenth 
consecutive misspelling in individual testing. In 
£roup testing the number of words dictated should 
be larger to allow for the greater variability of 
the individuals in the group. The raw score i$ 
the number of words correctly spelled plus sev 


еп. If a student gets ten words right, her score 
is ten plus seven. 


Norms: 


They are established on 4052 cases. Grade 
ratings, mental age equivalents and test vet 
tients are based on Terman-Merrill's table 0 АТ 
І. Q.'s which are listed in the table of the Manu 


Reliability and Validity: 


The average time of administration is ыы) 
minutes. Its correlation with the New Stanfor t 
Dictation Test 15.93. The reliability сое, 
determined by repeated testing was .88 (120 са568): 


Arithmetic: 


This test consists of 79 computation problems 
printed on the inside pages of the test blank. = 
ditions, Subtractions, multiplications, and а 
isions are printed іп Separate rows to epe 
errors due to change in the operations. The 
may be administered individually or in а group: 
There are no Specific standard instructions. 
Subject is simply asked to answer or solve 25 
many of the problems as he can. f 

The total arithmetic score is the number 0 
problems correctly solved. The grade ratings 
corresponding to the raw scores are found wit 


p аа 


way. 


—I € ——— 
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É mental age equivalents and test quotients in 
€ table of the manual. 


Reliability and Validity: 


E test was given to 4052 students from first 
“Жалалы; through the senior year of college. It 
Dutation Т, with the New Stanford Arithmetic Com- 
ity eoeffi est to the extent of . 91. The reliabil- 
.90 icient determined by repeated testing was 
(120 éases) 


Michigan Speed of Reading Test, Form II 
Author: 


Edward B. Greene 
P 
Urpose and Description: 


pe test is designed to measure one's ability 
and we of reading. This test has two forms, 
Orm со the latter is used in this study. Each 
of кае қалы of seventy-five 30-word sections 
One Word i complexity. In each section there is 
ing of the - the last part which spoils the mean- 
“Wron, irst part. The task is to find the 
this it word” and cross it out. In order to do 
“бтар S пебеввату to read nearly Ше whole раг- 
18 only'b Or each part alone makes sense and it 
“Wrong y Comparing the two halves that the 
Th. Word’? is found. 
еп йр тыы in both forms, I and II, were chos- 
Orndike. exceptions from the first 5000 of 
Matter į e's Teacher's Word Book. The subject- 
Common, (аКеп from school and home situations 
ally, = to third and fourth grade children. Fin- 
two piles. 300 items, 150 were separated into 
teal f S in a random order and printed in ident- 
AShion, » (39) 


Amin; 
Ministration: 


Th 
con ition ms can be administered under group 
Senior Ns to students from third grade to college 
form, > Seven minutes are allowed for еас h 
allow , Before administering the test for record 
б е students to work the sample sections. 
rms: š 


Тһе 
түзде p pe show the subject’s position in his 
ци Equi erms of a standard score and centiles. 
te tage Valent of the raw score is also given for 
noettiong = of persons in grades, for 1.9. dis- 
M S are апа for Usual Letter grades. The 

920 жекеден оп 3302 persons ranging 1n age 
Relig . 


bili 
lity and Validity: 


lability of Form II by split- halves 


T 
"ete Tel 
i 
5.86, and for Form I the reliability со" 
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efficient is . 83. 

The Kuder Preference Record 
Author: G. Frederic Kuder 
Description: 


The Kuder Preference Record consists of 330 
paired-comparison items arranged and scored 
in such a manner that а profile of preference 
scores is obtained in the following nine general 
areas: (1) scientific, (2) computational, (3) mech- 
anical, (4) persuasive, (5) artistic, (6) literary, 
(7) musical, (8) social service, and (9) clerical. 
The Preference Record is designed for use with 
both high school and college students. There is 
no time limit, but most persons can finish it with- 
in a class period of forty minutes. 

The unique format of the Preference Record 
is worthy of comment. The test itself consists 
of a direction page and eleven pages of test items 
which are attached permanently by means of ten 
small rings within a heavy cardboard cover. А 
detachable answer sheet containing eleven col- 
umns corresponding to the eleven pages of the 
test rests inside the back cover. The test book- 
let may be used repeatedly, therefore, used ans- 
wer sheets may be removed and new ones insert- 
ed. There are three types of answer sheets— 
one for hand scoring, one for machine scoring, 
and one for self-scoring. The self-scoring fea- 
ture appeals to schools with limited clerical re- 


sources. 
Validity: 


«Kuder is to be commended in that he has pro- 
vided more statistical data concerning his Pref- 
erence Record than usually is available for a new 
test. He has shown that the preference type of 
item is fairly stable in that it measures about the 
same thing when set up in different form and text. 
He has also shown that when academic aptitude 
scores and average college grades were used as 
criteria of validity, the validity of items origin- 
ally selected in rank order form will, when tried 
out with a different group, hold up about as well 
in paired-comparison form as in the original 
form." (11) 

From research, the results of the Kuder Pret- 
erence Record indicate in general that the names 
assigned to the various scales are appropriate in 
terms of the type of occupation entered as well 
as in terms of the activities for which the scale 
is scored. Chemists are found to be particular- 
ly high on the scientific scale, writers on the lit- 
erary scale, musicians on the musical scale, ac- 
countants оп the computational scale, and so on. 

Lehman (59) studied graduates of the School 
of Home Economics of Ohio State University who 
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have entered various vocations. The home ec- 
onomics teachers scored relatively high in so- 
cialservice,artistic, and scientific fields, and 
low in the persuasive and clerical fields. Hos- 
pital dietitians were very high in the scientific 
and social service areas and somewhat high in 
the computational field, while being extremely 
low in the persuasive area. 

Hahn and Williams (41) studied the Kuder Pref- 
erence Record scores of women reservists inthe 
Marine Corps engaged in various military occü- 
pations. Among the significant deviations from 
the average were the following: high mechanical, 
artistic, and scientific preferences, and low lit- 
erary, musical and clerical preferences for avi- 
ation assembly and repair workers; high clerical 
and low mechanical preferences for stenograph- 
ers; high scientific and mechanical preferences 
for aviation machinist mates; high persuasive 
and social service preferences and low scientif- 
ic preferences for duty non-commissioned offi- 
cers; and high mechanical and artistic prefer- 
ences and low musical preferences for Officers, 
technical specialty. 

Mangold (66) and the author of the test made 
a comprehensive study of the profiles of women 
students preparing for various occupations such 
as physician, nurse, occupational therapist, dent- 
al hygienist, and so on. They found among seven- 
ty occupational therapists high mechanical, sci- 
entific, artistic, and social service scores, and 
low computational and clerical preferences, 


Reliability: 


The reliabilities obtained for the Kuder Pref- 
erence Record scales from various groups are 
all close 10.90. Traxler (108), with forty-one 
graduate students had the following reliabilities 
(using repeat reliability with a three day inter- 
val): mechanical . 97, computational .98, scien- 
tific .95, persuasive .96, artistic . 97, literary 
. 95, musical .95, social service .93, and cler- 
ical.98. Triggs (109), reports that 166 college 
students had the following reliabilities: mechan- 
ical .94, computational .90, scientific .93, per- 
suasive .93, artistic .91, literary . 90, musical 
.90, social service . 91, and clerical . 89. 

Mangold (66), in a similar study of groups in 
various college majors, obtained results similar 
to those of Triggs and Traxler. The median of 
his four groups was . 91 and the average reliabil- 
ities for the different scales were close to . 90. 


Norms: 


The profile sheet for use in interpreting scores 
has been developed from distributions of scores 
obtained from 1858 high school boys in the xo 
omore, junior and senior classes, and from 
high school girls in the sophomore, junior, an 
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senior classes. In each case the three classes 

were weighted equally in computing norms. The 
profile sheet contains separate profiles for boys 
and girls. 

Kuder (55) reports norms for college students 
are being developed, although there is some ques- 
tion as to the value of general college norms in 
view of the fairly wide variation in average scores 
among groups from different colleges. 


The Purdue Pegboard 


Author: Developed by Purdue Research Founda- 
tion 


Purpose: 


“Тһе Purdue Pegboard is a test of manipula- 
tive dexterity designed to assist tn the selection 
of employees in industrial jobs requiring manip- 
ulative dexterity, such as assembly, packing, ОР” 
eration of certain machines, and other routine 
manual jobs of an exacting nature." (83) 

The test provides separate measurements of 
the right hand, left hand, and both hands together, 
and measures dexterity for two types of activity- 
One type of activity involves gross movements ч 
of the hand, fingers, and arms, and the otherin 
volves primarily what might be called «р of the 
finger” dexterity needed іп small assembly work. 


Description: 


The pegboard is a wooden board with two го 8. 
of holes (25 in each row), equipped with four com 
partments (cups) at the top end which hold pins, 
washers, and collars. The extreme right and t 
left hand cups each contain 25 pins. The pam 
(cup) immediately to the right of the center ha 
20 collars, and the compartment immediately 10 
the left of the center contàins 40 washers. 


Administration: 


The subject should be seated comfortably at p 
à table approximately 30 inches high with the рев 
board directly away from the subject with the а 
cups containing the assembly parts at the far ей 
of the board. 

The first Sequence tests the right hand. THE, 
Subject is instructed to pick up one pin at a tim 
from the right hand cup and place these pins i? 
the right hand row, starting with the top hole. 
The testee is allowed to put in five or six pin$ 
for practice before this part of the test is beg" 
The subject is allowed 30 seconds to put in aS 
many pins as possible with the right hand. + 
first score recorded is the total number of pin? 
the subject places with the right hand. e 

The second sequence tests the left hand. ТИ 
ваше procedure as above is followed. The sub 
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ubl, аша 30 seconds to take pins one at a 
left ha T the left hand cup and place them inthe 
After Es хом of holes starting with tne top hole. 
айан right and left hand sequences have been 
ject to tered, all pins are returned by the sub- 
Th the right and left cups, respectively. 
eously, г sequence tests both hands simultan- 
cup With ü e subject takes pins from the right 
the left Ae right hand and from the left cup with 
In the ty nd and simultaneously places the pins 
allowed d rows of holes. Another 30 seconds is 
is the total this sequence. The score recorded 
alf minut number oí pairs of pins placed in the 
Completed, of testing. After this sequence is 
lis scores En fourth score is obtained by totaling 
Sequences. he subject has made on the first three 
аи sequence tests more minute finger 
Collars genes consists of assembling the pins. 
ject is б washers. In this sequence the sub- 
ies аз ең one minute to make às many assem- 
еге. The пе can with the pins, collars, and wash- 
both e bison important point to explain is that 
nately, оп should be operating all the time alter- 
Зеро. ВІСКШЕ пра ріп, опе а washer, опе 
г, апа во оп. 


Scoring. 


_ The 
Pins Score for the right hand is the number of 


loq, [ during the thirty-second testing per- 
umber ие for the left hand ріп test is the 
регіо > pins placed during the thirty-second 
of Жаз d for the two hand pin test, the num" 
Ute test irs of pins placed during the half min- 
15 the woe The score on the assembly test 
Minute кетед of assemblies made during the one 
e te. Ung period. 
hand а thus results in five scores: а right 
ым lina an а left hand score, а 5соге for both 
ед sc left hands used simultaneously, 2 com- 
Опра рте of the first three зедиепсе5, and à 
€r-collar-washer ¿assembly score. 


Norms; 


‚ Se 
Па uns norms are available for each of these 
але une Which give raw score norms and their 
ud thre € equivalents for one trial, two-trial, 
orm Мый ыы administrations. The one-trial 
ге based on 954 applicants. 


liabi]; 
bility and Validity: 


Th 

t e š | | 

n the то lability of the test опа one-trial basis 

002, ang и hand, left hand, and both hands 15 

teat Sie the assembly test 15.14: The two- 

и Вресц od yields reliabilities of . T1 and . 84, 
method the re^ 


ap; tiv 
bili ier For the three-trial 
are ,83 апа . 89, respectively. 
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As to the validity of this test, considerable 
data have been accumulated, but government reg- 
ulations prevent the release of these data. The 
test was standardized in numerous government 
defense plants опа wide variety of industrial jobs. 
In one plant more than 4000 employees were test- 
ed, those making a score in the upper 30 percent 
being placed on the jobs requiring greatest dex- 
terity. This procedure has given thoroughly sat- 
isfactory results in employee job performance. 


The Minnesota Rate of Manipulation Test 
Author: W. A. Ziegler 


The Minnesota Rate of Manipulation Test is 
designed to measure native speed capacity ог 
muscular reaction time. In certain occupations, 
both shop and office, rapid use of hands and fin- 
gers in machine operations and handling of tools 
and materials is such an important factor that a 
worker’s success is largely dependent upon the 
speed at which she can work. Speed is primarily 
a native trait, improvable only to a limited ex- 
tent. When workers increase production per unit 
of time, the increase is due to improved effic- 
iency technique, and not to an actual increase in 
physical speed of manipulation. Muscular re- 
action time is а unique trait the magnitude of 
which is easily and reliably determined by the 
Minnesota Rate of Manipulation Test. Any means 
that will make it possible to avoid useless and 
costly waste of time in trial and that will dismiss 
method of selecting applicants for work requir- 
ing speed will be a great benefit to the employer 
and applicant alike. This test measures two 
kinds of speed, hand speed (placing test) and fin- 
ger speed (turning test). These abilities are dif- 
ferent from finger and tweezer dexterity tests. 


Description: 


The test is a rectangular poard which has 60 
round identical holes cut in it (4 rows of 15 each). 
The subject must place 60 round, equatone, ident- 
ical blocks into these holes іп а prescribed order 
for the placing test. The subject must pick up 
the blocks with one hand, turn them over, and 
place the blocks pack into the Same holes with 
the other hand for the turning test. The two ends 
of the blocks are painted, red on one and yellow 
on the other, for ease of checking and maximum 
visibility. Scores for each test are the total 


times in seconds for four trials. 


Norms: 


Random samplings of total population as sel- 
ected by the Minnesota Employment Stabilization 


Research Institute were used in establishing the 
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norms. The raw scores are transcribed into 
Scores of percentile, quartiles, percent place- 
ment, and qualitative terms of speed. 


Validity and Reliability: 


Correlation between hand and finger speeds 
15.57. Different average scores are made by 
known different levels of mechanical ability. A 
publishing house shifted employees around so that 
those with high speed scores worked where fast 
handling of materials was important and the out- 
put was doubled. А wholesale house increased 
its production ratios by effective selections based 
оп test results. Jurgensen (49) tested a groupof 
men hired as converting machine operators in a 
paper mill and the reliability was . 75. Тһе re- 
liability of the test with cashiers at a department 
Store, reports Jurgensen, was .90. The correl- 
ation between the Rate of Manipulation Test and 
the Pennsylvania Bi-Manual Worksample was .46. 


The Revised Minnesota Paper Form Board Test 


Authors: R. Likert and W. H. Quasha 


Description: 


The Revised Minnesota Paper Form Board 
Test is à modification of the paper form board 
test prepared by a group at the University of Min- 
nesota. The original paper form board test was 
found by its authors to have а relatively high val- 
idity for the prediction and measurement of mech- 
anical ability and to differentiate between the var- 
ious grades of proficiencies of mechanical abil- 
ity. The earlier test was difficult to score and 
the scoring involved an undesirable element of 
subjectivity. This revision has overcome some 
of these limitations. It is used because itappears 
to have important guidance values which may be 
developed with further use and experimentation. 
The revision simplifies the scoring by changing 
the items to the multiple-choice type. The pres- 
ent form has 64 items, each consisting оға dia- 
gram of from 2 to 5 disarranged parts of a geo- 
metrical figure. In each item, there are 5 dia- 
grams indicating how these parts might appear 
if fitted together. Only one of the 5 choices is 
correct. The standard time limit is 20 minutes. 
Norms are available for time limits of 14 and 25 

minutes, but the 20 minute time limit should be 
used. The test presumably measures the same 
type of ability as is required in the test of spa- 
tial relations. It measures ability to visualize 
spatial patterns in two dimensions. The evidence 
accumulated appears to indicate that high scores 
on this test are predictive of ability to —— 
mechanical drawing and it is predictive o 509 ЕА 
cess in mechanical occupations. ес: x 
pencil task involves more of the linguistic typ 
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of intelligence, than does the formboard. 
Purpose: 


The test can be used for examinees of 9 years 
and above. The authors have not shown conclus- 
ively that the scores for older age groups have 
the same meaning as those for the younger groups. 


Norms: 


The authors furnish percentile norms for а 
considerable number of groups such as freshman 
engineering students, senior engineering students, 
liberal arts college freshmen, high school seniors, 
adults, elementary school boys and girls. 


Reliability: 


The coefficient of reliability indicates the de- 
gree to which the test consistently measures the 
same factor. The reliability of a single series 
of the test is 0.85. When both series аге admin" 
istered the reliability is 0.92. It should be noted 
in this connection that it is more desirable to giye 
both series in preference to one, as the score ob 
tained from giving both series will be more гей” 
able. 


Validity: 


The coefficient of validity indicates the degree 
to which the test correlates with a criterion oÍ 
mechanical ability. Of all the tests used in the 
Minnesota Mechanical Ability Battery, the Minn 
esota Paper Form Test was the only paper-and" 
pencil test to give satisfactory correlations wit 
a criterion of mechanical ability. Engineering & 
Students score about 6 points higher on the aver 
age than do arts college students. The authors 
report a correlation of +. 49 obtained between. 
Scores made on the revised form and mechanic? 
drawing grades for 174 students. There is a CO 
relation of +. 40 between the test and Otis Self- 
Administering Examination. 


Mechanical Comprehension Test, Form АА 


Author: George K. Bennett 


. 


Description: 


This test is designed to measure the capacity 
9f an individual to understand various types O 
physical relationships. This type of ability 15 
important in physics courses, trade sc ho 0 
courses andin engineering schools. Also itis de- 
Signed to measure ability to understand mechan 
ical devices. It consists of Sixty drawings an 
simply phrased questions. It has a minimum € 


e -————— I 
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fe š 
en т and rote knowledge of phys- 
мыз tonn is suitable for use with high school 
Probabl r with adults of comparable education. 
tend to n a result of cultural factors, girls 
Derlence a. ike the type of problem present. Ex- 
eme nd education do have an appreciable in- 
lencar scores. However, most of the prob- 
e so presented as to require understand- 


MEGT Mente ысы 
нні EIES involved ratner than rote 


Administration: 


Th 
ab ate no time limit. Ordinarily a 
twenty-five ity complete the test in twenty to 
ing more me and little is gained by allow- 
Pictorial booi thirty minutes. The test hasa 
re simply onler with the sixty questions which 
п answer Bh gioco The answers are placed on 
and-scored eet which can be macnine-scoredor 
. In either case, the score equals 


© numb А 
Wrong er right minus one-half the number 


I 
nterpretation: 


The 
evaluated үг, for each person tested should be 
Priate is relation to the norms for an appro- 
may pe mno Students about to leave high school 
білегін т жесір with high school seniors, еп” 
tro liia] о ool freshmen, or candidates Гог 
rade r apprentice training courses. For 


is ; > х 
Е ома и courses, manual dexterity 


Sliabs); 
bility аһа Validity: 


The s 

ры реа, correlation of the test, corrected by 

Fade, t an-Brown formula, is . 84 for a single 
m is апдага error of a score is 3.7 points. 
9 “аге, ма direct evidence of validity is 
lego chani ach item correlates with a composite 
40° fresh cal tests, Fry (31) reports Arts Col- 
3 men (65 cases) earn а mean score of 


(46 „Which is s; 
e ) fara Significantly lower than the mean 
Se o irst year engineering students. Inthe 


5 

temen applicants for technical courses a 

lou; Sas) to previous training in physics was 
5 train; 220 individuals reporting such ргеу- 

99га hg thé mean was 41.7. 207 08 persons 

-7, 18 по training in physics the mean was 


Th 

& e 

Me та foi relation of this test with other tests 

by Abū WS: Otis Self-Administerins Test of 
і Пеги 25; Minnesota Paper Form Board 

hort it Mechanical Aptitude Examination .54; 


Alpha Examination . 47. 
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The Minnesota Multiphasic Personality 
Inventory 


Authors: Starke R. Hathaway and J. Charnley 
McKinley 


Purpose: 


«The Minnesota Multiphasic Personality In- 
ventory is a psychometric instrument designed 
ultimately to provide, ina single test, Scores 
on all the more important phases of personality. 
The point of view determining the importance of 
a trait in this case is that of the clinical or per- 
sonnel worker who wishes to assay those traits 
that are commonly characteristic of disabling psy- 


chological abnormality." (45) 


Description: 


There are two forms of the Inventory—the 
group (paper and pencil) and the individual (card- 
sorted) types. The individual type was used in 
this study. Both forms of the instrument com^ 
prise 550 statements, each printed in simple lang- 
uage on a separate card or in the pooklet. The 
statements cover а wide range of subject matter— 
from the physical condition to the morale and the 
social attitudes of the individual being tested. 

The personality characteristics now in avail- 


able form for scoring are hypochondriasis, de- 
hysteria, psychopathic personality, 


pression, 
masculinity-femininity, paranoia, psychasthenia, 
schizophrenia, and hypomania. Others are inthe 


course of development. 
«A brief description 0: 
sonality characteristics foll 


{ the aforementioned per- 
ows: 


Hypochon- measures abnormal concern about 
driasis bodily functions, health, complains 
of pains and disorders. А highscore 
shows that person is unduly worried 


about his health. 


measures depth of the clinically rec- 
ognized symptom or symptom com- 
plex, depression. A high score in- 
dicates poor morale with a feeling 

of uselessness, lack of self-confi- 


dence. 


Depression 


measures degree to which subject is 
like patient who has developed con- 
version-type hysteria symptoms 
(systemic complaints, paralyses, 
cramps, gastric or intestinal com- 
plaints, or cardiac). 


Hysteria 
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Psychopath- measures the similarity of the sub- 

icDeviate ject to a group of persons whose 
main difficulty lies in their absence 
of deep emotional response. A PD 
digresses from social mores and 
breaks out in stealing, lying, alco- 
hol, and sexual immorality. 


Interest Measures tendency toward masculin- 

(Mf) ity and/or femininity of interest pat- 
tern. МЇ score is important in vo- 
cational choice. 


Paranoia measures persons characterized by 
suspiciousness, oversensitivity, de- 
lusions of persecution, with or with- 
out expansive egotism. 


Psychas- measures the similarity of subject 

thenia to psychiatric patients who are 
troubled by phobias or compulsive 
behavior, excessive worry. 


Schizo- measures the similarity of subject 

phrenia responses to those patients who are 
characterized by bizarre, and unus- 
ual thoughts or behavior. 


Hypomania measures the personality factor 
Characteristic of persons with mark- 
ед over-productivity in action and 
thought. Тһе hypomanic patient has 
usually gotten into trouble because 


4 undertaking too many tnings. " 
44) 


Administration: 


The subject is asked to sort all the cards in- 
to three categories indicated by guide cards, 
True, False, and Cannot Say. Thetime required 
for administration varies widely but is rarely 
longer than 90 minutes and is commonlyas short 
as 30 minutes. Very little instruction and no su- 
pervision are required. 

After the subject has taken the test tne num- 
bers of cards thus sorted are tabulated on a sim- 
plified record sheet, that provides the basic rec- 
ord to be scored by any one of the various keys. 


Norms: 


The chief normative group for the standardi- 
zation of the scales consisted of 810 individuals 
representing a cross section of the Мона 
population as obtained from visitors я Pu a 
versity Hospital. “А break down of the Б 
351 married women, 119 single MÀ ни 
ried men, 111 single men. Тһе Ae per жк 
adequate for Ше ages 16 to 55 and for bo k 


Reliability and Validity: 


“Тһе chief criterion of excellence has been 
the valid prediction of clinical cases against the 
neuropsychiatric staff diagnosis, rather than 
Statistical measures of reliability and validity. T 
Nevertheless, tne reliability coefficients of E 
So far developed in final form range between . 
and .83.” (73) р 

These correlations were obtained by testing 
and retesting a group of 40 normals at intervals 
of a week or less up to several years. А 

This test has included in the final profile of 
theInventory three validating scores. They are 
the Question score, Lie score, and the Validity 


(Е) score. They are briefly described as fol- 
lows: 


Question ‘‘Consists of the total number of it- 
ems put in the CANNOT SAY category: 
The size of the score affects паи 
nificance of the other scores. А оре 
derline score’’ (Question score) рг 
ably means that the subject's eade 
Score, if he had not used the Canno 
Say category at all, would deviate b= 
farther from the average than his о 
Served score indicates. 


Lie а measure of the degree to which Ше 
Subject may be attempting to лме 
his scores by always choosing then 
sponse that places him in the ert 
acceptable light socially. A high her 
Score does not invalidate the ot al- 
scores but indicates that the true " 
ues are probably higher than thos 
actually obtained. 


Validity Serves as a check on the validity б 
Ше whole record. И the Validity re 
Score) is high, the other scales 4 t 
likely to be invalid either because 
subject was careless or unable 10 
comprehend the items, or because 
Someone made extensive errors in 
entering the items on the record 
Sheet.*' (44) 


Washburne Social-Adjustment Inventory 
Author: John N. Washburne 


Purpose: 


$ 1: 
The primary purpose of the Washburne Bur 
Adjustment Inventory is to determine the deb" g- 
of social and emotional adjustment of an indiV 
ual. The score is designed to give а separate 
measure of development in each of six traits, 
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Which are very slightly correlated with intelli- 
&ence and are nighly correlated with social and 
emotional adjustment. The score is also design- 
€d to give a measure of adjustment in allthe traits 
Combined. In the total social-adjustment score, 
Strength in one trait may compensate for weak- 
ness in another, as is also the case in actual 50- 
Cial situations. Scores for tne separate traits 
More particular difficulties, and this is of ser- 
ice in diagnosis and remediation. The test is 
а useful instrument in counseling, teaching, 
8rouping, and experimenting. 


Description 


oos test is an eight-page booklet containing 
бево оша апа ап answer sheet, and student's 
ing es The Inventory has a set of three scor- 
ea €ncils, or keys, for hand scoring. Separ- 
d sen Sheets and stencils specially prepar- 
machine scoring are also available. 
потта test is self-administering and self-explan- 
Sày-t 9 the person taking it. It contains one е5- 
ала ын апа six objective-type subtests of social 
ains Merci adjustment. The test also con- 
Sco Subtest of truthfulness, or test accuracy, 
able Шел of which indicates how valid and reli- 
(wishes total score is. Тһе essay-type subtest 
intervie. 1s of importance chiefly for purposes of 
Supe Wing and differentiating between degrees 
in eet adjustment, and need not be scored 


the Mime compare individual test results with 


T E А 
Айе Subtests are Truthfulness, Happiness, 


à tion, Sympathy, Purpose, Impulse-Judg- 
letters Ontrol, and Wishes. From the initial 
Сощед of the subtests—-except Wishes—has been 
Of th the word «Thaspic’’ by which the edition 
6 test is known. 
т Tief description of the subtest follows: 
rut 
пез: This trait indicates to what degree 
Or ге was relative freedom from deliberate 
th Unintentional inaccuracies in answering 
H е Questions, 
Bs 
i 
№ Тһе term includes contentment, а. 
vense of Well-being, and the feeling that life 
Worthwhile. 


Alienar; 
a. This term measures the individual's 

al Se of social membership and acceptance, 
а Sense of basic similarity, or of com^ 
"manity with others. 


, 


batheti This term is defined as sensitive, em- 
People.” non-negative responsiveness to 
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Purpose: This personality measure indicates sat- 
isfactory adjustment as one definitely directs 
himself toward his aim, goal, evaluation, 
selection, and effort. 


Impulse-Judgment: This term is defined as the 
ability to judge well between conflicting im- 
pulses, so that satisfactions are not discount- 
ed in favor of easier or more immediate but 
obviously lesser satisfactions. 


Control: This trait indicates tne sense of self- 
control, seli-regulation, and the ability to 
make and execute plans. 


Validity and Reliability: 


The number of populations tested was between 
thirty and forty and (пе number of individuals 
tested was well over 10,000. The bi-serial гсо- 
efficient of validity 18.90. As a further check 
on validity, it was found that the correlation be- 
tween the total scores on the Inventory and intell- 
igence is negligible -.07. Archer (2 ) found tnat 
the coefficient of reliability as determined by a 
retest of approximately 400 college students аї- 
ter an interval of one semester is . 92. The prob- 
able error of an individual's total social-adjust- 
ment score is 5. For the subtests the approxi- 
mate of the coefficients of reliability is from .80 
to . 90. 


Interpretation: 


There is no time limit for the test, but the 
average person will finish it in about 45 minutes, 
including the filling in of tne Student's Record. 
Scores on the Social Adjustment Inventory may 
be tabulated, and measures of central tendency 
computed to determine the social adjustment of 
the group as a whole. 

The first step in interpreting the test results 
is to fill in the Profile Chart. Norms are print- 
ed on the face of this chart in order to facilitate 
graphing the positions of the individuals in rela- 
tion to the norms. The chart is made merely by 
picking out from among the printed scores those 
earned by the examinee in the various subtests 
and in the total test and then joining these points 
by a line. | 

In the middle of the Profile Chart are two 
heavily leaded lines indicating the median score 
for junior high school, senior high school, and 
college students in each of the subtests and in the 
total test. To interpret the specific scores see 
the ‘‘ Percentile Ranks'' and the “Levels” print- 
ed at the top of each column. The levels are giv- 
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en as Exceptional (Exc.), Superior (Sup.), Well- 
Adjusted (W-A), Normal (Norm. ), Low Normal 
(L.N.), Borderline (Bor.), and Maladjusted (Mal.). 


Test of Practical Judgment 


Author: Alfred J. Cardall 


This test is designed as a measure of ability 
to reason in practical situations. It is a test to 
measure the element of practical judgment in 
everyday business and social situations. Prac- 
tical judgment consists of an individual's ability 
to recognize possible alternatives in solving a 
problem and to select the best solution. This 
quality is good in selecting individuals for re- 
sponsible work. It may be observed that in ord- 
inary situations a nuniber of alternatives Spring 
instantly to mind, the element of judgment oper- 
ating when one course of action is chosen over 
others. 

‘This measurement is unique and Statistically 
independent of such factors as intelligence, aca- 
demic and social background. Practical judgment 
is an important consideration in the selection of 
executives, supervisors, Salesmen, and those 
who are working in contact positions, and those 

responsible for planning and Supervising work. 
Schools use the test as a measure of Social mat- 
uration, ’’ states Cardall. 


Description: 


The-test is published in а sixteen-page book- 
let and presents two practice and forty-eight test 
problems. Тһе majority of the questions require 
the subject to indicate his first, second, andthird 
choices for solving the problems. The subject 
punches his responses on the test booklet, and 
his or her answers are automatically recorded 
by the pin-punch method as correct or incorrect. 
The highest possible score is 342 points. The 
highest score to date is 271, recorded by a trat- 
fic officer. 


Reliability and Validity: 


The reliability of this test, computed on a 
homogeneous group, is .88 by the method of split- 
halves and .86 by the Kuder and Richardson t 
formula. In other samplings, but on a smaller 
number of cases in wnich the range of ability has 
been greater, the reliability coefficient has beem 
materially higher. A number of Сер нека exper 
iments are being carried оп with this pu 
in order to determine its ue cetus 
in a variety of situations. In : * 
completed ina wp wr) kem E a 
5 ; correlated .56 with '' ° 

p accounting department 45 oeque eid 
pooled ratings. Executive sampling i 
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even higher relationships. 


Norms: 


The first set of norms is based on 303 high 
school seniors. School administrators, concerned 
with social maturation of students or counselees, 
will find these norms applicable at this level and 
a year above or below. The other set of norms 
is based on 212 adults doing supervisory work 
and is applicable in business and industry. 


C. Description of Rating Scale 


The simplest method of getting an estimate of 
personality traits is the rating scale. In the use 
of this method a scale is first more or less arb- 
itrarily established by the person who is to use 
it. The extremes represent the most possible 
or the least possible quantity of the trait,and as 


many intervening scale intervals can be used as 
seen desirable. 


“Rating is essentially directed obser- 
vation. It is of no value unless the ob- 
Servation on which it is based is accur- 
ate. Unfortunately, persons confronted 
with a neat and inviting rating scaleare 
tempted to cooperate by putting checks 
in the spaces provided for that purpose 
even though they have only a meager 
basis for judgment. The mechanics of 
rating is so easy; accurate judgment so 
difficult. 

“Тһе rating scale is a quantitative 
method of recording and summarizing 
observations and judgments based on 
Observation. The field of observation, 
and therefore the scope of rating, is 
unlimited. Rating may be directed 
toward the process of learning as well 
aS to the end-products. Thus the rat- 
ing scale becomes an important instru- 
ment for studying the processes by 
which personality is modified. ” (70) 


The history of the rating scale movement 6065 
back about forty years, Parker (78) attempted ke 
to trace the development of rating scales and та 
а critical analysis of the Scales. He found there 
has been a Steady increase in the number of гаї 
118 scales and а tendency toward more objective 
ratings, specialization of raters and objective 
Standards of comparison, all leading to higher 
reliability and validity of the scales constructed: 

May and Hartshorne (67) list three devices for _ 
obtaining the judgment of teachers and one for ОР 
taining the opinions of students: 


1. The conduct rating scale, which uses _ 
phrases or sentences to describe the various 16У 


B —— вва й нн > e SŘ M ŘE 
Ba --- 
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els of behavior. 
| 2. A check list, consisting of descriptive ad- 
Jectives. 
_ 3. Portrait-matching, a verbal picture of a 
Biven type of personality. 
"e The “guess who"' test, expressed in а ser- 
of descriptions of a single phrase or sentence. 


жңне rating scale used in this investigation, 

Е is the conduct rating scale type, was for 
Biden DM of getting supervisory ratings of the 
öne ten in training and therapists in the field 
and to poten completing the prescribed course), 
Such к ermine the relationship, if any, between 
5 bien aa and the objective measures of the 
est гез I therapists in the field based on the 
grade 29 ts, grade point average, and predicted 

Thi verage. 
partme, rating scale was constructed by the De- 
oo of Physical Medicine at the University 

eae to provide a means of reporting Ssys- 
a m the student's personal and profession- 
fessional 5 and characteristics, as well as pro- 
its const preparedness traits. The first step in 
ical Ме тый was the requesting oi the Phys- 

inito s faculty at the University ої Wiscon- 
they нація what personality characteristics 
Пел moo important for therapists in the 
Чу me in their pre-service training. The fac- 
асе н а submitted lists of personality сһаг- 
indicating о together with explanatory remarks 
Various 5 Something of what was meant by the 

aoe traits named. 
ion зен returns a master list of four pro^ 
Qualifj preparedness traits, twelve profession- 
Song] 008 characteristics, and fourteen 
the à "qualifications traits was drawn up. Since 
Черт su area to be an avoidable and undesirable 
fain Сот Overlapping among Ше qualities, cer- | 

М заха апа eliminations were made be 
Under cuit Scale was finally adopted. 
he professional-preparedness category 


1o] Е 
lowing traits were used: 
1. т 
heory; 


tem 


the 


a. Knowledge 
b. Application 
е 1 

Chniques: а, Knowledge 
b. Application 


ling 
tion the Professional-qualifications classifica- 
9llowing characteristics Were used: 


A 

АЫ нев to patient 

E ag impart instructions 
huie ability (еадегзтр-оге 
Ive (take appropriation on own) 


X — 

hi anization) 
Cat; 2 

`. Ness in preparation of work 

Pr 


„Ст нм со NP — 


с 
9nomy of materials 


а Р 
ofe. S, о! supplies and equipment 
SSinnal! орь and sHnuette 
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7. Records 
a. Recognize importance 
b. Neatness. 
C. Accuracy 

8. Professional interest 


The fourteen qualities in the personal-qualif- 


ications group used were: 


Adaptability 

Emotional stability 

Poise 

Sense of humor 

Tact 

Judgment 

Dependability 

Intellectual curiosity 

Cooperation with personnel 

Ability to prolit by instruction and criticism 
Loyalty to department and personnel 
. Punctuality 

Personal appearance 

. Health 


m m ка ка к 
> со БО ра © со со і Ф сл > ыы 


The rating scale used in this study has five 
units, steps, ог intervals. They are superior, 
above average, average, limited, and unsatis- 
factory. 

Five instructors in Occ 
wellas five instructors in Physical Therapy rated 
their respective students. The ratings of thefive 
instructors were then pooled and an average rat- 
ing for each quality was submitted from the five 
ratings. This was done for both Occupational 
and Physical Therapists. For those girls already 
in the field ratings were used which had been 
by one person, and in some cases, two, 
three, and four raters judged the rating scale. 

Many of the judges or raters made use of the 
space appropriated for **Remarks'' in the lower- 
fourth of the rating scale. Many clarifying state- 
ments were written by the raters concerning the 
students' traits, OT the therapists' qualities in 
the follow-up. This rating scale 15 strictly a sub- 


jective measure. 


upational Therapy, as 


judged 


Weighting of Scale: 


The scale had three general categories, thus 
equal weight Was given to the three classifica- 
tions. The entire rating scale was given a total 
weight of three hundred, one hundred for each 
category. The four traits in the first classifica- 
tion were given values of 25 points each, a total 
of 100. The next category, professional-qualif- 
ications, gave 8.33 points to each of the twelve 
eie 2 total of 100; and the fourteen qualities 
5. hird classification, personal qualifications, 
m e values of 1. 14 points each, a total 


of 100. 
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Тпе faculty of the Departments of Occupation- 
aland Physical Therapy have drawn up an inter- 
pretational key for the rating scale used in this 
Study. The interpretational key gives explana- 
tory remarks of what is meant by the various 
personality characteristics and traits named. 
The interpretational key follows: 


Interpretational Key for the Rating Scale 


Theory - Knowledge 
S. Thorough understanding of medical 

background, theory of O. T. and relat- 
ed information. Familiar with diag- 
noses met in patient contact and their 
implications. Knows precautions to 
be observed in practice. Understands 
treatment aims for each type of pa- 
tient and how to accomplish them. 


Theory - Application 
S. Has unusual ability to analyze problems 
and apply knowledge. Always has a 
planned program suited to the needs of 
each patient assigned. Follows this 
program, and can discuss it and mod- 
ify it if necessary. 


Techniques - Knowledge 
S. Has unusual knowledge and understand- 
ing of skills and techniques, mastery 
of all major activities, comprehension 
of many minor ones. Quick to utilize 
all opportunities to increase knowledge. 


Techniques - Application 
S. Has high standards of workmanship and 
executes with precision and Skill. А1- 
ways modifies techniques to patient dis- 


ability. Shows originality and resource- 
fulness, 


Approach to Patients 
S. Inspires and sustains interest, confi- 
dence and cooperation in all types of 
patients. Does not arouse undesirable 
response. Treats the patient as an in- 
dividual and observes and considers 
his reactions. 


ili mpart Instructions А 

d ч " pu considers the mental, physical 
and intellectual abilities of the patient. 
Knows thoroughly what is to be taught 
and has it broken down into logical 
steps. Adjusts method and amount of 
instruction to the individual patient and 
is almost always successful. 
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Executive Ability - Leadership-Organization 

S. Always budgets time, plans and ex- 
ecutes efficiently. Gives all factors 
in a situation the correct amount of й 
attention. Adjusts plans easily to chang 
ing circumstances. Willing to assume 
responsibility for making decisions. 
Directs action of others and is always 
accepted with confidence. 


Initiative 
S. Always able to inaugurate plans and 4 
operations, has ideas about what shoul 
be done in unusual situations and can 


proceed unassisted. Always “вей- 
Starting. ” 


Neatness in Preparation of Work " 
S. Always has tools and materials readily 
accessible. Works in an orderly fash 
ion, and always leaves work space in 
perfect order. Designs are well рге- 
pared, measurements and cutting al^ 
Ways accurate. Finishing processes 
precisely and attractively done. 


Economy of Materials - 

: Knows the value and special паши 
of materials in stock and always use 
them appropriatély with minimum Оз 
Waste. Always resourceful and dis 
criminating іп salvaging and using 
waste material. 


Care of Supplies and Equipment ау5 
S. Always keeps track of tools апа alway 

puts them away in their proper phe 
Knows the function of tools and н 
uses them correctly. Systematicaly 
keeps tools and equipment clean an à 
5004 working order. Reports eg 
or need for repairs immediately. Ке м 
Supplies in an orderly, accessible ar~ 
rangement and protected from deteri 
oration and loss. 


Professional Ethics and Etiquette s 
Understands the purpose behind p 
and regulations, the necessity for 0 ge 
Serving channels and customs, and 8 
Ways abides by them. Always cour 
teous and well mannered. 


Records - 


5 Recognize Importance 


Understands purposes of records Dada 
the hospital, physicians, O. T. depart 
ment and the student. Reads or P 

tices writing them seriously and to 


—— x 
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best advantage. Realizes the import- 
ance of concise, clear and trustworthy 
presentation. 


Records - Neatness 
S. Records are well typed or legibly writ- 
ten, no obvious corrections or erasures. 
Always well arranged and professional 
in appearance. 


Records - Accuracy 

5. Records аге factually correct. Give 
a true picture. Show proper interpre- 
tation and pertinent selection of what 
has been read, as well as valid obser- 
vation and precise reporting of patient 
reaction. Spelling and grammar cor- 
rect, terminology appropriate. А11 
records kept up to date. 


Professional Interest 

8. Spares no effort to become successful 
in O.T. Does extra reading, takes ad- 
ditional courses, voluntarily helps with 
exhibits, sales and inventories to in- 
crease competence. Greatly interest- 
ed in department organization and co- 
Ordination of O. T. with other depart- 
ments. Keeps abreast of current trends 
in O. T. and allied professions. 


Adaptability 
Always able to adjust to people and sit- 
uations pleasantly, quickly and effic- 
iently without lowering own standards. 
Flexible. 


= —rYO P. 
— r ----------» 7), 


Emot; 
Motional Stability 
* — Never reacts unduly to difficult or fav- 
orable situations or to the needs of 


| Others. Not moody. Keeps profession- 
al problems out of personal life and 
і Vice versa. Mature. 
Poise 
| S. 


Gives impression of thorough selí-con- 
trol. Always does the appropriate and 

graceful thing. Has a well-modulated 

voice. 


8 
i of imor 

' — Sees and enjoys the incongruities of 
life, no matter how subtle. Сап laugh 
at own mistakes and profit by them. 
Discovers, appreciates and appropri- 
ately expresses the lu 
at the expense of others. 


1 
| 


Tact 


Always sensitive to the needs of others 
and instinctively does the kindly, gra- 


dicrous, butnever 
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cious thing that makes them comfort- 
able. Can usually make suggestions 
or give correction without hurting feel- 
ings or arousing antagonism. 


Judgment 
S. Considers all factors in a situation 
(even in emergencies), weighs them 
quickly and accurately, comes to log- 
ical and wise decisions and knows how 
to implement them. 


Dependability 
S. Can be counted on to do the right thing 
in all situations. Carries pertinentin- 
structions out to the letter. Initiates 
appropriate action. Never fails to take 


responsibility. 


Intellectual Curiosity 
5. Acquires additional knowledge for own 


satisfaction. Looks up unfamiliar 
terms. Discusses new Situations. Stud- 
ies departmental records, forms and 
methods and the reason for their use. 
Asks intelligent questions at appropri- 
ate times and follows up suggested ma- 
terial. 


Cooperation with Personnel 
5. Always willing to lend a hand and is 


generous about sharing equipment and 
facilities. Works unselfishly for group 
results, subordinating personal likes, 
dislikes and interests in order to work 
effectively with others. Always thinks 
of the effect on others before request- 
ing special consideration. 


Ability to Profit by Instruction and Criticism 
5. Is a pleasure to instruct. Listens in 
a receptive and intelligent manner to 
any help or suggestion offered. Com- 
prehends and utilizes new techniques 
or concepts. Evaluates criticism. 
Corrects faults. 


Loyalty to Department and Personnel 
5. Habitually considers reputation of de- 
partment . nd hospital in her speech 
and actions, on and off duty. Does not 
gossip. Will give constructive Sugges- 
tions and criticism to authorized per- 


sons only. 
Punctuality 
S. Always prompt and has all work com- 


pleted at the appointed time, р 
have to be reminded of тени 
deadlines. 
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Sonal Appearance 
EN S. E all regulations pertaining to 
uniform. Has an erect, graceful car- 
riage, habitually pleasant, alert man- 
ner. Neat and well groomed at all 
times. Creates an extremely favorable 
professional impression. 


Health 
S. Has plenty of energy for both workand 
recreation. Does extra work cheerfully 
and efficiently. Seldom shows fatigue, 
rarely ill. 


D. Description of Subjects 


The group of students used in this research 
study consisted of all the students in the Depart- 
ment of Physical Medicine of the University of 
Wisconsin. For this investigation, two hundred 
and thirty-four Occupational and Physical Ther- 
apy students were administered the complete bat- 
tery of twelve tests. Their ages ranged from 17 
years to 45 years of age. 

The subjects included 43 Physical Therapy 
Certificate Course Students, 33 Physical Therapy 
four-year degree course Students, and 158 four- 
year course students in Occupational Therapy. 
The certificate course Тог physical therapy tech- 
nicians is twelve months in length and begins in 
September of each Year. College credit toward 


а degree.in Physical Therapy is given for this 
УОГК. 

Among Ше forty-three Physical Therapy Cer- 
tificate Course students were included four male 
students, and two men students were among the 
33 degree trainees in Physical Therapy. Occu- 
pational Therapy had no male trainees, 


E. Procedures Used in Personnel Research 


The subjects were contacted through the mail. 
Тһе students were sent a postal card informing 
them of the time, place, and reason for the test- 
ing. All of the group tests were adminis tered 
in Memorial Institute of the University of Wiscon- 
sin Hospital. Students unable to meet at the spec- 
ified time were granted another time. АЦ of the 
individual tests were given in the Educational 
Building. АП of the tests were given in the even- 
ing. Two evenings were necessary for the group 
tests, and one evening was sufficient time for the 
tests which were administered СА : 
In the administration of the battery of tes а 
it should be pointed out that the ен E 
the sole oe ET hio итн Й 
ests. As stated рге , ан 
dere ЕНЕ in Memorial еее 
administered in и 
D ее the rooms were furnish- 
1 . 


ed properly with lighting, equipment, ventilation, 

omfortable seats. т 
шо of the most difficult aspects of the admin 
istration of the testing program is that whi ch қ 
deals with the scoring of tests. Scoring is vae 
ious work, which requires much time and ам 
оп the part of the administrator. This part й. 
the work the present investigator planned wi 
extreme care in order that accurate results may 
be obtained and in order that the writer may re- 
tain favorable attitudes toward the testing pror. 
gram throughout the whole task of scoring. ЕУ 
ery precaution was taken to these ends. 


Since scoring of the tests was burdensome, {= 
every precaution was taken for securing the oy 
est accuracy with the least amount of time an 
effort. 

The first step in preparing for scoring was 
for the writer to see to it that he read carefully 
all the directions accompanying the tests. The 
Second step was to provide a minimum of ргас- 
tice in scoring. The third Step was the actual 
Scoring, which was done, as it always should eo 
done, with colored pencils. Because it is 1108 
conducive to accuracy and most economical of 
time the writer scored by single pages of a test; 
whenever it was applicable. 

During the process of scoring, the scheme й 
of checking Correct, omitted, and incorrect ans A 
wers was adhered to without exception. The eum 
тагу of the scores obtained were placed in ap 
propriate positions on each page and totaled for 
each test. re- 

After the scoring had been completed, the 
Sults of all the tests were placed on the graphic 
profile of the data form. Тһе test profile vs o 
the names of all the tests, raw scores, рга б= 
placements, and percentile ranks so that the Б ыр 
sition of each pupil may be easily and quickly 
termined from the graphic profile. in- 

The two-page data form used in this quas (е 
cluded the following items: complete name O 
Student, classification (course and year), зех т» 
race, descent, degrees held, date of birth, ma 
ital status, rank in family among brothers an 
sisters, rank in high school graduating class, 
nuniber of students in high school graduation 
class, major course in high school, types © 
extra-curricular activities. 

The data form also included previous pes salt 
earning experiences (kind, employer, and un 
reason for choice of course, period of time tha 
the tests were administered, the names of 211 


the tests, raw Scores, percentile rank, and pm 
chograph of all the tests. 


F. Statistical Procedures Employed 


The earliest st: 


udies dealing with the prognos“ 
of college succ 


ess used existing psychologic? 
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E LIED tests were introduced to predict 
inent in ge success in general and course achiev- 
lective subject areas. At first the primary ob- 
ВЕ dem the prediction of probable college suc- 
diction ( ater the emphasis shifted to the pre- 
od) of ¢ actually a refinement in statistical meth- 
Sesion Goa з probability of success ша 
found о Little positive relationship was 
menti ween the test results and college achiev- 
- in these early studies. 
M mme this early development and use of 
Ba кол and ability tests at the college level, 
Sonality = gradual growth in the areas oí per- 
ing. It a ptitude, interest, and judgment test- 
of these ey that the improvements in the use 
Sion of б have come about through an ехіеп- 
interes, ing to cover such diverse factors as 
Chieveme "py personality, intelligence, a- 
heb nt, and judgment. 
ies of E relationship existing between a ser- 
measures салама measures and college success 
Interpret, loes not always tell the entire story. 
tent diede of test results differs to some ex- 
Surround ЛЕ to the conditions and circumstances 
Wasa the individuals being tested. 
Was to де сеч that the purpose of this study 
е цзеа ан if a given battery of tests could 
Pational ia success in physical and occu- 
needed to erapy. The specific questions which 
е answered were: 


int 


1. 
Srage Dy well do the predicted grade point av- 
Оп the id grade point average, and scores 
Негару? ividual tests correlate with success іп 
2. 
Bre ed the results of Question 1 merit use in 
relation kd Success in therapy by a multiple сог- 
qns rel; €chnique? Stated in other words, how 
à Whole ationship exists between the battery as 
Я miu Success in therapy? 
ath Othe,» Well do the measures correlate with 
amet hors To what extent do they measure the 
“Plate дон wen do part scores on Ше tests cor- 
25. uccess in therapy? 
rin idera use can these data be in adminis- 
р dance to the students? 
за 10 
ща 10 approaching Ше first problem, two 
Sto tests dli ions had to be answered: (1) On 
Ang ез be elding part scores could the part 
(2) „+ dded together to give а total score, 
ОЇ su at criterion was to be used as а meas" 
The мы in therapy? 
тед Ocedure in which the first question was 
Drp he Қамыс as follows: 
by Videg "Ctions for scoring some of th 
th, om € €thods of computing total scores, either 
ше пер tion of part scores, ог otherwise. For 
Мене this method was used. The follow- 
ments were treated in this manner: 


e tests 
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Wechsler-Bellevue Intelligence Scale, California 
Mental Maturity, Wide Range Achievement Tests, 
Michigan Speed of Reading, Purdue Pegboard, 
Minnesota Paper Form Board, Bennett Mechan- 
ical Comprehension, and the Cardall Practical 
Judgment. 

The tests which did not provide total scores 
and which demanded a diíferent treatment were: 
Kuder Preference Record, Minnesota Rate of 
Manipulation, Minnesota Multiphasic Personal- 
ity Inventory, and the Washburne Social Adjust- 
ment Inventory. 

In the case of the Kuder Preference Record, 
it was decided that no total score would suffice. 
Therefore, two interest scores were chosen, 
which in the judgment of the committee members 
and the author of this study, related most highly 
to success in therapy. These were Scientific- 
Interest and Artistic-Interest. Scores on these 
were included as two separate test scores in the 
first analysis. The other scores were omitted. 

In the Rate of Manipulation test, the scores on 
both parts (placing and turning) were not compar- 
able. The placing test was based on a perfect 
score of 300, and the turning test on a score of 
200. Both scores were treated separately. 

Regarding the Multiphasic Personality Inven- 
tory, and the Washburne Social Adjustment In- 
ventory it was decided to combine part scores to 
yield a kind of “index of adjustment" resulting 
from this combination. Data regarding each part 
score was analyzed. 

On the Multiphasic Personality Inventory, а 
high score on any scale indicates а tendency tow- 
ard abnormality in that area. This is true onall 
scales, except the Masculinity-Femininity scale. 
On this scale a high raw score indicates better 
adjustment. Therefore, the method used to get 
the so-called index of adjustment was to sum all 
part scores except those of Masculinity-Femin- 
inity and then subtract from this sum the raw 
score on Masculinity-Femininity. Thus a high 
score would indicate roughly a high degree of 
maladjustment. 

On the Washburne, the opposite was the case 
as a high score in any area indicates a high de- 
gree of adjustment in that area. Part scores 
were simply added to get a total score. Herea 
high total score indicated a high degree of total 
adjustment. 

The best available estimate of success in ther- 
apy was the rating given a student by her super- 
visor and clinical instructors during her senior 
year. This subjective rating sheet (exhibit B, 
Appendix), consisted of a five-point scale con- 
structed by the Department of Physical Medicine. 
The students were rated on specific traits in 
three areas. These areas (professional prepar- 
edness, personal qualifications, and profession- 
al qualifications) were weighted equally. One 


hundred points were allowed in each area for а 
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total possible score of three hundred. Тһе nu- 
merical value of a check mark in any level was 
indicated on the rating scale. | 

The total points on each rating scale give the 
total rating for the student. After transforming 
all the data into quantitative terms, it was pos- 
sible to answer Question 1, regarding correla- 
tions of test scores, predicted grade point aver- 
age, and actual grade point average with success 
in therapy. | . 

The predicted grade point average at the Uni- 
versity of Wisconsin is based upon the grade point 
average earned in high school and the score earn- 
ed by tne student on the American Council on Ed- 
ucation Psychological Examination which is given 
during freshman week. In the case of a transfer 
student the test is also administered during that 
week. The formula used for predicting grade 
point averages is as follows: 


X, .0180X2 + .0197Х; - 1.1016 


Formula where X, is the predicted grade point 
average in the University of Wisconsin, X; isthe 
American Council on Education Psychological Ex- 
amination percentile score based on National 
Norms, X; is the high school percentile rank. 

Since ratings were available for only those 
Students who had clinical experience, this part 
of the analysis was limited to 1946 and 1947 grad- 
uates. These students totaled only thirty-one in 
Physical Therapy and forty in Occupational Ther- 
ару. Statistically, these did not comprise a suf- 
ficient number of cases to warrant the application 
of the rating scale for obtaining correlations with 
the test scores, actual grade point average, and 
the predicted grade point average. Тһе results 
are shown in columns one and three of Table 1. 

А broader discussion of these statistical anal- 
ysis procedures is found in Exhibit A of the Ap- 
pendix. 


SECTION IV 

ANALYSIS AND INTERPRETATION OF FINDINGS 
A. Analysis of Findings 

THE PURPOSE of the statistical analysis was 
to determine if the battery of the tests chosen, 
the predicted grade-point average, and the actual 
grade point average could be used for predicting 
success in the field of therapy. Тһе specific ques- 


tions to be answered were: 


1. How well do the predicted grade point av- 
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erage, the actual grade point average, and scores 
on the individual tests correlate with success ш 
therapy? 


2. Do the results of Question 1 merit use in 
predicting success in therapy by a multiple cor- 
relation technique? In other words, how much 
relationship exists between the battery as a whole 
and success in therapy? 


3. How well do the measures correlate with 
each other? In other words, to what extent do 
they measure the same thing? 


4. How well do part scores on the test cor- 
relate with success in therapy? 


5. Of what use can these data be in adminis~ 
tering guidance to the students ? 


The mean and percentile scores of the br am " 
tests for the entire group of two hundred and thirty 
four students are shown in Table I. The means 
of the Multiphasic Personality Inventory and the Е 
Washburne Social Adjustment are not included be 
Cause, as previously stated, these two instru- 
ments did not provide total scores, therefore, | 
they demanded a different treatment. It was de 
cided to combine the part scores of the Mul s 
phasic and Washburne so as to yield a kind of ‘i 
dex of adjustment” resulting from this combine 
tion. Data regarding each part score was ana 
yzed. had 

The Wechsler-Bellevue Intelligence Scale 
а mean of 114. 901 (80th percentile) which p 
the score in the above-normal classification; b3 
California MentalMaturity had a mean of 117. x 
(85th percentile), and the Wide Range Achieve" 
ment Test had a mean of 113. 259 (79th percen 


tile), both means being in the above-average са 
egory. 


The means of the Scientific and the Artistic _ 
areas of the Kuder Preference Record меге tile), 
642 (67th percentile) and 60. 522 (73rd percen на 
respectively. These scores indicate above 27 # 
аве interests, as апу score above the 50th рег 
centile is considered a definite interest p 

The mean of the total score of the Purdue an 
board was 82. 034 (83rd percentile); and the "a 
Scores of the Placing and Turning of the Ratt ile) 
Manipulation Test were 223. 720 (74th pere 
and 184. 690 (70th percentile), respectively; 
Paper Form Board Test had а mean of 44. 46 
(88th percentile); and the mean scores of pae 
Mechanical Comprehension Test and Practic? 
Judgment were 39. 582 (53rd percentile), ап 
208.065 (73га percentile). 


| 
| 
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TABLE I 


MEANS AND PERCENTILE SCORES OF VARIOUS TESTS FOR THE 


ENTIRE GROUP OF STUDENTS* 


(N = 234) 

Name of Test Mean Percentile 
Wechsler-Bellevue 114. 901 80 
California Maturity 117.233 85 
Wide Range Achievement 113.259 79 
Speed of Reading 51.194 70 
Scientific - Kuder 57. 642 67 
Artistic - Kuder 60. 522 73 
Purdue Pegboard 82. 034 83 
Placing - Manipulation 223.720 74 
Turning - Manipulation 184. 690 70 
Paper Form Board 44. 461 88 
Mechanical Comprehension 39.258 53 

208. 065 73 


Practical Judgment 


* The means of the Multiphasic Personality Inventory and the 


Washburne Social Adjustment I 


cause they are expressed in other values. 


nventory are not included be- 
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Тһе correlations of the test scores, the pre- 
dicted grade-point average, and the actual grade 
point average with the ratings on the scale and 
with the scores obtained from ranking are shown 
in Table IL * The standard error of these correl- 
ations was found to be . 183 for the Physical Ther- 
apists and . 160 for the Occupational Therapists. 
In order to be significant each of these correla- 
tions should be twice this large. 

The correlations between the ratings of the 
Scale and the rankings were .43 and .39 for phys- 
ical therapy and occupational therapy students, 
respectively. | 

The correlations between the predicted grade 
point average and the physical therapy ratings 
was .41 and with the occupational therapy ratings 
.36. With the rankings the predicted grade point 
average correlated . 40 with the thirty-one Phys- 
ical Therapists and . 41 with the forty Occupation- 
al Therapists. 

The Turning Test of the manipulation measure 
correlated .35 with the original ratings (Physical 
Therapy) and the Placing part of the manipulation 
instrument correlated .31 with the Occupational 

Therapy group of forty students. The Mechanical 
Comprehension Test correlated . 32 with the orig- 
inal Occupational Therapy ratings. 

The intercorrelations (Table III) which showed 
а fair amount of relationship were the actualgrade 
point average and the predicted grade point aver- 
age (. 70); the Wechsler-Bellevue Scale and the 
predicted grade point average (.65); the Wechsler- 
Bellevue and the actual grade point average (.53); 
the California Mental Maturity and the predicted 
grade point average (.53); and the California 
Mental Maturity with the actual grade point aver- 
age (. 59); and the Wechsler-Bellevue with the 
California (. 63). 

The Wide Range Achievement Test has inter- 
correlations of . 51, .61, ‚57, and . 70 with the 
predicted grade point average, the actual grade 
point average, the Wechsler-Bellevue Scale, and 
the California Mental Maturity, respectively. The 

other achievement test, Michigan Speed of Read- 
ing, had correlations of . 46, -50, .61, and . 76 
with the predicted grade point average, the actual 
grade point average, the Wechsler -Bellevue, and 
the Wide Range, respectively. | 

There was significant positive relationship of 
the Paper Form Board Test with the following 
measures: the predicted grade point average (.32); 
the academic grade point average (.29); the Wech- 

sler-Bellevue (.29); the California Mental Matur- 
ity (. 35); the Wide Range Achievement (. 20), and 
the Speed of Reading (. 20). 


and the actual grade-point averagee 
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The Bennet Comprehension had intercorrela- 
tions of .26, .29, .28, .23, .12, .19, and .23_ 
with the predicted grade point average, the res 
demic average, the Wechsler-Bellevue, the Са 
ifornia Mental Maturity, the Wide Range, the ы 
Speed of Reading, and the Paper Form Board, г 
Spectively. 

Other significant intercorrelations were the Ds 
Turning part of the Manipulation test with the Pu 
due Pegboard (. 40) and with the Placing of pua I 
Manipulation instrument (. 56). Also, the Was 
burne Social Adjustment correlated .25 with the 
Multiphasic, .26 and .23 with the Placing and 
Turning of the Manipulation test, respectively. 

The Artistic score of the Kuder Preference rd 
Record correlated . 27 with the Paper Form Boare 
and .27 with the Washburne Social Adjustment In 
ventory. | 

The standard error of these correlations 15 
.066, anda correlation to be significant must 
have an absolute value equal to or greater than 
- 132, which is twice the standard error. t 

Statistical consideration was given to find ou 
the extent to which the correlations between the 
actual grade point average, the predicted grade 
point average, the instructors’ ratings, and the 
test scores merit use in predicting success in 
therapy by a multiple correlation technique. 

Because of the small number of cases, and 5 
also because of a lack of significant corrélatio я 
the results do not seem to merit further analys 
until more cases are available for study. t 

An analysis was made concerning the ape 
to which part scores on the tests correlate pc 
Success in therapy as based on the criteria 0 rade 
the predicted grade point average, the actualg 
point average, and the instructors’ ratings. the 

The first step was to determine if some of 
part Scores might be better indices of success re- 
in physical therapy than the total scores. Тһе 
Sults of this breakdown are shown in Table үз. 
Неге араїп, only the 31 cases for which rating 
were available were used. A correlation to be 
Significant had to have an absolute value of at 
least .37. Only a few of the correlations are re 
large. They are the following: the Verbal ее 
of the California Mental Maturity, . 38; the Mus 
ical score of the Kuder Preference Record, . 77" 
the Truthfulness and Happiness scores of на 
Washburne Social Adjustment with . 54 and . 40; 
respectively. with 
The last phase of the study was concerned the 
the effectiveness with which the test results; pe 
ratings, the predicted grade point average, t 
actual grade point average, and the data form 


this 
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TABLE II 


CORRELATIONS OF TEST SCORES WITH RATINGS MADE ON RATING SCALE 
AND WITH SCORES OBTAINED FROM RANKING 


(N = 31) (N = 40) 
Physical Therapy Occupational Therapy 
Correlation with Correlation with 
Test Rating Ranking Rating Ranking 
Wechsler-Bellevue .23 .20 -.01 .13 
California .20 .24 . 02 204 
Wide Range “17 123 118 128 
Speed of Reading -. 07 .10 -.01 -.07 
Scientific - Kuder -.15 -.24 -.03 -. 13 
rtistic - Kuder .13 .26 .01, „18 
purdue Pegboard 114 114 206 -.20 
placing Manipulation .10 -.08 -31x - 07 
ра в Manipulation -.35 х -. 01 -.22 201 
orm Board .31 „32 Š 29 А ü 
€chanical i . 05 -. 03 39 ж 20 
Ultiphasic ананын 224 -. 14 -.11 . 06 
Washburne 291 -.05 -,22 =, 15 
Judgment 206 207 -.01 -.20 
cademi .28 .30 122 „14 
"eni spa .Alx .40 x .36 x .41 xx 


Tedicted grade point average 


= . 160 

rror = .183 Standard error 
Sepe error = . 366 2 x Standard error = . 320 
Correlation between ranking and Correlation between ranking and 


rating = . 43 rating = .39 

= Signifi % level x = Significant at 5% level 
aS р ВЕРА, Tevel xx = Significant at 1% level 
uii з 3 (.312 and . 403) 


(. 355 and . 456) 
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TABLE IV 


CORRELATIONS OF PART SCORES WITH RATINGS 
PHYSIO- THERAPY GROUP 


(М = 31) 
Correlation 
Test Part with Ratings 

Wechsler-Bellevue Verbal .18 
Wechsler-Bellevue. Performance .26 
California Verbal .38 х 
California Non-Verbal .34 
Wide Range Reading .21 
Wide Range Spelling 421 
Wide Range Arithmetic .34 
Kuder Mechanical .04 
Kuder Computational -.22 
Kuder Persuasive .02 
Kuder Literary .25 
Kuder Musical .44 х 
Kuder Social Service . 06 
Kuder Clerical .36 
Purdue Both Hands .28 
Purdue Assembly .27 
Multiphasic Question =, 10 
Multiphasic Lie . 03 
Multiphasic Validity 2,119 
Multiphasic Hypochondriasis -.13 
Multiphasic Hysteria -.08 
Multiphasic Depression : -.08 
Multiphasic Psychopathic-Deviate -. 18 
Multiphasic Masculinity -Femininity . 07 
Multiphasic Paranoia -,84 
Multiphasic Psychasthenia =, 
Multiphasic Schizophrenia -.10 
Multiphasic Hypomania -.16 
Washburne Truthful .54 xx 
Washburne Happiness .40x 
Washburne Alienation .01 
Washburne Sympathy .16 
Washburne Purpose .01 
Washburne Impulse-Judgment -.00 
Washburne Control т; 29 


Standard Error = . 183 
2 x Standard Error = .366 


x = Significant at 5% level 
хх = Significant at 1% level 
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were used by the faculty members ot occupational 
therapy and physical therapy. Тһе Department 
of Physical Medicine made use of any informa- 
tion or knowledge available from the results of 
the tests, the data form, and the rating scale. : 
The Physical Therapy staff used these data in 
counseling fifty students. These data were used 
in revealing the abilities, interests, aptitudes, 
personality traits, personal data, and the limita- 
tions of which the students were sometimes una- 
uw of the fifty physical therapy students, be- 
cause of poor scholarship, a low predicted grade 
point average, and through the faculty's use of 
the test results and rating scale, were advised 
to drop the course. Indications of these students 
being unlikely to succeed in the course were evi- 
dent from the data gathered. The interviewing 
and advising of all the students was based on the 
best possible knowledge available about the indi- 
vidual. Three of the students advised to drop 
the course were eliminated later by the Univer- 
sity due to scholastic reasons. Тһе other two 
students left the course to avoid future disappoint- 
ment. 

The Occupational Therapy staff counseled 80 
Students. From this number, thirteen trainees 
were advised to drop the course because of reas- 
ons Such as low Scholarship, unsuitable person- 
ality traits, lack of Special aptitudes (manualand 
finger dexterity), conflicting interests, lack of ` 
artistic, mechanical, and scientific interests, or 
for any other significant maladjustment (social, 
mental, economic, or physical) which caused an 
inability for one to work to the full extent of his 
capacity in therapy work. Тһе data used in this 
guidance phase of the study were gathered from 
test results, the data form, the interview, and 
the rating form, all techniques of guidance which 
seemed to indicate a general prediction that the 
students would fail as occupational therapy stud- 
ents as well as professional therapists, 

Of this group of thirteen, eight students failed 
to make the scholastic grade; therefore, they were 
eliminated. The other five, due to changing inter- 
ests, lack of specific aptitudes, personality prob- 
lems, lack of judgment, asocial behavior, and 
low mentality were transferred to another course 
more suited to their total make-up. In all five 
cases, guidance was extended the students tow- 

s other fields. 
© must be emphasized here that the data со1- 
lected were used in assisting the poor, fair, and 

good student. Counseling of these students was 
positive guidance which was ре сн E ©. 
preventive in nature, as well as remedial. Fai 
ing students, Пение Mine, Vana" 
of-interest students, as . the be ] 
individuals were counseled. 
e E effectiveness of these data was also shown 
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when probable and imminent failures and other 
maladjusted students made good progress after 
they were counseled and advised in respect to 
their interests, intelligence, achievement, per- 
sonality, judgment, predicted level of academic 
achievement, aptitudes and abilities, and other 
pertinent factors. 

After the students were counseled a case sum- 
mary of every student was written. These sum- 
maries were placed in the Department’s files for 
future reference, along with other findings and 
information about the students. Summaries of 
three occupational and physical therapy students 
are presented in the Appendix, Exhibit N. 

These data were used, also, for further con^ 
sultations when the need had arisen for further 
guidance. As stated previously, it was the inten" 
tion of the Department's guidance and testing pro 
gram to establish positive guidance which was 
developmental and preventive in nature, 45 well 
ав remedial. The Department of Physical Med- 
icine wants to install a basic functional guidance 
program which can be developed so it is an inte- 
gral part of the total school program of every 
prospective physical and occupational therapist. 
The Department's System of studying individuals 
must be based on the best tested and secured 
knowledge about the nature of the personality. 
One cannot understand and counsel individuals 
without probing into the person's make-up in 
making an individual inventory. 

Following are the criteria which were devel- 
oped by the committee in conferences on guid- 
ance of the therapy students. They are suggest- 
ed merely as an aid in arriving at some sort of 
evaluation of a guidance program. 


1. Are the needs of the pupil determined? 
2. Are the chief interests of each pupil 
determined? in- 
3. Are the abilities of each pupil determin 
ed? 
Is each pupil's program definitely plan- 
ned in terms of his interests, his needs, 
and his abilities? 
9. Is each pupil made definitely aware of 
his special aptitudes or abilities? 
Is there a provision for systematic and, 
definite collection and recording of data! 
- Does the student understand that the ге- 
sults are to be used to assist him in &P- 
proaching his problem? 
8. Is the number of maladjustments гё 
duced? 
+ Is there a placement and follow-up P797 
gram? ? 
10. Is Ше number of retarded cases reduced’ 


11. Is there provision for adequate individu? 
counseling? 


AFP Lc 
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B. Interpretation of Findings 


" There was one total measure which had a suf- 
Iciently high positive correlation with the origin- 
al ratings and the rankings. The correlation which 
was found to be significant was the predicted grade 
point average, which correlated . 41 with the Phys- 
as Therapy ratings and . 36 with the Occupation- 
i Therapy ratings. Using the rank-order method 
€ correlations were . 40 and . 41, respectively. 

А of the correlations of the various tests 
efus пе ratings were small. This has some sig- 

as It appears that those correlations 
ind are of any size at all may be due to chance. 
i OW correlations with the ratings seem to in- 
Cate two possibilities: 


uati 1. The rating scale does not give a good eval- 

lon of the student as a therapist, and 

TÉ s. committee may have chosen some 
whi ` В : А 

баар са аге not highly related to success іп 


ra - ec noted that in cases where more thanone 
e s the Same individual or student was given, 
Bave i varied widely, that is, different raters 
е За Same student very different ratings on 
€ scale. 
ване results (Table II) also indicate that per- 
things on used did not measure the same 
галета СВ were looked for by the others, ог 
№ Correlating the measures, as shown in Table 
the a amount of relationship exists between 
вгаде ual grade point average and the predicted 
Scale Point average (. 70); the Wechsler-Bellevue 
and the predicted grade point average (.65); 
Уега ег -ВеЦеуце and the actual grade point 
the к (. 53); the California Mental Maturity with 
е Und grade point average (. 59); andthe Wech- 
“БеПеуше with the California (. 63). | 
дуета, m all indications, Ше predicted grade point 
two i the actual grade point average, and the 
ала  Швепсе tests, the Wechsler-Bellevue 
Ur = California Mental Maturity seem to meas" 
ations СУ the same things and have high correl- 


Е a achievement tests, the Wide Range and 
With i of Reading, had high intercorrelations 
tua] p © Predicted grade point average, the ac- 

x ma as point average, the Wechsler-Bellevue, 
tha, "€ California Mental Maturity. It is possible 
Same езе two instruments measure many of the 
thoy things that the other four measures do, al- 
This deg! do not correlate well with the ratings. 
testą НЕЙ degree of relationship between the two 
Зла > the Wide Range and the Speed of Reading, 
eas © other four instruments reveals that these 
Yigg “UTES may be appropriate ones to use to pre- 

Чссеѕѕ in therapy. 
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The low intercorrelations of the Mechanical 
Comprehension Test with all the other scores 
seem to indicate that the instrument does not 
measure the same thing as the other tests. 

The significant correlation of the Manipula- 
tion (rapid and accurate finger and hand move- 
ments) with the Pegboard (tip-of-the- finger 
movements and finer movements) warrants fur- 
ther use of the instrument in future research. 

There appears to be little or no relationship 
between the personality and the social adjustment 
tests and the interest inventory with the rest of 
ihe tests. From Table III, it is evident that the 
instruments seem to measure fairly unique, fine, 
and amenable traits of tne individual. These 
three measures may or may not be appropriate 
ones from which to predict success in therapy. 

Of the four part scores which might be better 
indices of success in physical therapy than the 
total scores only two seem to warrant further 
study with more cases, providing the rating scale 
does not give a good evaluation of the student as 
a therapist. These are the Happiness score 
and the Truthfulness score on the Washburne In- 
ventory. There was nota sufficient number of 
cases available to correlate part scores on the 
tests with the ratings. Only 31 cases were avail- 
able for use, therefore, the low correlations of 
all the part scores with the ratings may be due 
to one of three things: 


1. Not enough cases were available. 

2. The rating scale may not give a good eval- 
uation of the student as a therapist. 

3. The tests may not be appropriate ones 
from which to predict success in therapy. 


Because of the small number of cases, and, 
also, because of a lack of positive significant cor- 
relations, the results did not seem to merit fur- 
ther analysis in predicting success in therapy by 
a multiple correlation technique until more cases 
were available. 

The value of the guidance program in tne De- 
partment of Physical Medicine is almost wholly 
dependent upon the effectiveness with which the 
results are used by the faculty. Intelligent and 
wide use of the data (test results, ratings, and 
other pertinent information) calls for a definite 
plan of testing and of organizing and reporting 
the results and rendering them understandable to 
the students and faculty. 

The Department has adopted а policy and a 
systematic program using these data to counsel 
students in connection with problems involving 
diagnosis, prognosis, treatment, and counseling. 
Helpful suggestions were extended to allof the 
students. Students not suited for occupational 
therapy or physical therapy were advised to 
change to a course more Suited to their interests, 
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aptitudes, intelligence, personality traits, and 
other factors. Other students, who appeared 
likely to succeed in therapy were advised and 
counseled as to their progress. Failing students, 
as well as the more adjusted trainees, weregiven 
thorough guidance and help in attaining possible 
objectives. 

The following reasons were given for Ше causes 
of failures, drop-outs, and maladjustments: 


. Low scholarship 

. Low intelligence or mental ability 

Change of interest and conflict of inter- 

ests 

. Personality deviations 

. Lack of specific aptitudes (finger and man- 

ual dexterity) 

6. Asocial and antisocial behavior 

7. Low actual and predicted level of achieve- 
ment 

8. Maladjustments (emotional, social econ- 
omic, mental, or physical) 

9. Poor mental or physical health 


со го н 


с > 


The value of this guidance program was noted 
by: 


1. The number of cases in which the cause 
of maladjustment was eliminated and the 
individual student was enabled to work to 
the full extent of her capacity. 

. The number of cases in which improve- 
ment was shown in making the proper ad- 
justment. 

3. The number of cases in which the correct- 

ive adjustment seemed to have been perm- 
anent. 


. The number of drop-outs prevented. 


г 
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results of these tests were compared with the 
subjective rating of the students by their instruc- 
tors and clinical supervisors during their train- 
ing period. The committee with this study estab- 
lished the following primary objectives in the pro^ 
gram: 


1. 


To provide accurate and meaningful measure- 
ments of the individual's interests, intelligence; 
aptitudes, personality traits, achievement, 
mechanical aptitudes, and judgment. 


- To assist in the selection of students with po^ 


tentialities to make good physical or occupa- 
tional therapy students. 


- What is a reasonable expectation of achieve- 


ment in physical or occupational therapy by 
each individual? 


To what extent is each person limited by дей 
telligence, interest, aptitude, judgment, an 
personality ? 


Is success related to intelligence, personality: 
interest, aptitudes, achievement, and judgmen™ 


This study consisted of two parts. The first 


part involved the administration of twelve tests 
to 234 students of physical therapy and occupa 
tional therapy. 


The second part of the study was concerned 


with the rating of the students with a five-point 


rating scale which was concerned with profess 


jon^ 


al preparedness, personal qualifications, ап 
professional qualifications. 


The purpose of the statistical analysis was 19 


The number of failures prevented. 
. Good adjustment made by students in other 
fields who left Occupational and Physical 


о ол нь 


determine if the battery of tests chosen, the рге 
dicted grade point average, and the actual grad 
point average could be used for predicting suc” 
cess in the field of therapy. The specific ques 


Therapy due to change of interest, person- 
ality problems, lack of certain aptitudes, 
or for any other significant maladjustment, 
who received valuable assistance and 
counseling from the faculty of the Depart- 
ment of Physical Medicine. 


SECTION V 


SUMMARY, CONCLUSIONS, AND RECOMMEN- 
DATIONS 


Summary 


An attempt has been made to develop a pro- 
gram which might provide reliable information 
for judging the suitability of a student for nm 
cal therapy or occupational therapy work. 2 Ye Me 
tests were administered experimentally and the 


tions to be answered were: 


1. 


е 
How well do the predicted grade point Ве а 
the actual grade point average, and Ше SCOT 


on the individual tests correlate with succes? 
in therapy? 


- Do the results of Question 1 merit use in PTC 


dicting success in therapy by a multiple COT á 
relation technique? In other words, how MY 
relationship exists between the battery as 2 
whole and success in therapy? 


A h 
- How well do the measures correlate with 620 


other? In other words, to what extent do ше 
measure the same thing? 


How well do part scores on the test correlat? 
with success in therapy? 


June, 1957) 


5. ot what use can these data be in administer- 
ing guidance to the students? 


А careful survey of available information from 
published reports and references was made and 
information was gathered from the University of 
Wisconsin Library and the Department of Physi- 
cal Medicine. The survey of literature also in- 
Cluded books and pamphlets listed in the Educa- 
tion Index and the Reader's Guide to Periodical 
Literature. 

Ж Тһе data presented in this study were secured 
the University of Wisconsin by using a battery 

СА ПН, а rating scale, а да а form, and other 
2 Ormation gathered from the subjects, the Stu- 
Рі Counseling Center, and the Registrar's of- 
s predicted grade point average was the 
e ad measure which had a very high signif- 
Бе Correlation with the original ratings and 

h ings. It correlated . 41 апа. 36 with the 

о Therapy and Occupational Therapy stu- 
diee ratings, respectively, and using the rank- 
Рено нак the correlations were . 40 and . 41, 
ie - ively. Тһе correlations between the rat- 
39 for the Scale and the rankings were .43 and 
ару г Physical Therapy and Occupational Ther- 

Students, respectively. 

With ine of the correlations of the various tests 
ве -- ratings were small. It appears that 
may b Orrelations which are of any size at all 

wi е due to chance. The low correlations 


it } 
В the ratings seem to indicate two possibilities: 


1. : 
Тһе rating scale does not give а good evalua- 


Чоп of the student as a therapist, and 


The committee may have chosen some tests 


Е аге not highly related to success inther- 
y. 


the t fate amount of relationship exists between 
gr: Ctual grade point average and the predicted 
Intel}, Point average (. 70); the Wechsler-Bellevue 
Тере Бейсе Scale and Ше predicted grade point 
tual 28€ (. 65); the Wechsler-Bellevue and the ac- 
Меле de point average (. 53); the California 
age ( Maturity with the actual grade point aver- 
аш ); and Ше Wechsler-Bellevue with the 
Ornia (. 63). 
to = all indications, these instruments seem 
Slo, e SUPE the same things and have high correl- 
Sea, Which warrant further use in future re^ 
and study with success in therapy. 
the з е achievement tests, the Wide Range and 
ti of Reading, had high correlations and 
avera p relations with the predicted grade point 
Меснао the actual grade point average, Ше 
These ler-Bellevue, and the Mental Maturity. 
Use 5 measures seem to be appropriate ones to 
Predict success in therapy. 
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There was positive relationship of the Paper 
Form Board Test with the following measures: 
the predicted grade-point average (. 32); the ac- 
tual grade point average (.29); the Wechsler- 
Bellevue (. 29); the Mental Maturity (.35); the 
Wide Range Achievement (. 20); and the Speed 
of Reading (. 30). This instrument does not seem 
to measure the same things that most of the other 
instruments do. 

The Comprehension Test had intercorrelations 
01.26, .23, .12, . 19, and .23 with the predict- 
ed grade point average, the academic average, 
the Wechsler-Bellevue, the California Mental Ma- 
turity, the Wide Range Achievement, the Speed 
of Reading, and the Paper Form Board, respec- 
tively. Though these correlations and intercor- 
relations were low with other measures, this 
small relationship has nothing to do with the val- 
ue of the test in predicting success in Physical 
Medicine. It may be the best instrument of the 
entire battery. If the Mechanical Comprehension 
Test does not correlate with success in therapy 
then it should be discarded. 

The Turning part of the Manipulation Test cor- 
related . 40 with the Purdue Pegboard and . 56 
with the Placing of the Manipulation Test. This 
test, to some extent, seems to be an appropriate 
one from which to measure success in therapy. 

The Washburne Social Adjustment Inventory 
correlated .25 with the Multiphasic Personality 
Inventory; .26 and . 23 with the Placing and Turn- 
ing of the Manipulation Test, respectively. There 
appears to be little relationship between these 
two personality measures with the rest of the 
tests. It should be clearly stated that low inter- 
correlations with other measures has nothing to 
do with the value of the test in predicting success 
in therapy. 

The next approach was concerned with the ex- 
tent to which the correlations between the predic- 
ted grade point average, the actual grade point 
average, the instructors’ ratings and the test 
Scores merit use in predicting success in ther- 
apy by a multiple correlation technique. Only31 
cases were available. Because of the small num- 
ber of cases, and also, because of a lack of sig- 
nificant correlations, the results did not seem to 
merit further analysis in predicting success in 
therapy by а multiple correlation technique until 
more cases were available. 

It is evident that the instruments seem to meas- 
ure fairly unique traits of the individual, butthese 
measures may or may not be appropriate ones 
from which to predict success in therapy. 

The Artistic score of the Kuder Preference 
Record correlated .27 with the Paper Form Board 
and .27 with the Washburne Social Adjustment In- 
ventory. This test may be an appropriate one 
from which to predict success in therapy. 

The fourth question was concerned with the 
extent to which the part SCores of the tests cor- 
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relate with success in therapy as based on the 
criteria of tne predicted grade point average, the 
actual grade point average, and the instructors 
ratings. неща: 

The first step was to determine И some ofthe 
part scores might be better indices of success 
in physical therapy than the total Scores. Only 
the 31 cases for which ratings were available 
were used. A correlation to be significant here 
had to have an absolute value of at least . 37. Only 
a few of the correlations were this large. 

The part scores and their correlations follow: 
the Verbal score of the Mental Maturity Test .38; 
the Musical score of the Kuder Preference Rec- 
ord .44; the Truthfulness and Happiness scores 
of the Washburne Social Adjustment Іпуепіогу. 54 
and .40, respectively. 

Of the four which were statistically significant 
two of them seemed to warrant further study with 
more cases, without any questions asked. These 
are the Happiness score and the Truthfulness 
score on the Washburne Inventory. Statistically 
speaking, there was not a sufficient number of 
cases available to correlate part scores on the 

tests with the ratings. The low correlations of 
all the part scores with the ratings may be due 
to one of three things: 


1. Not enough cases were available. 

2. The rating scale does not give a good 
evaluation of the student as a therapist. 

The tests may not be appropriate ones 

Írom which to predict success in therapy. 


3. 


The last phase of the study was concerned with 
the effectiveness with which the test results, the 
ratings, the predicted grade point average, the 
actual grade point average, and the data form 
were used by the faculty members of occupation- 
al and physical therapy. 


The Physical Therapy staff used these data in 
counseling fifty students, and the Occupational 
Therapy staff advised eighty students. The stu- 
dents were counseled concerning their interests, 
aptitudes, personality traits, personal data, and 
the limitations of which the students were some- 
times unaware. It must be emphasized that the 
data were used in assisting the poor, fair, and 

student. 
ge of the fifty physical therapy Students, be- 
cause of some good reason, were advised to drop 
the course. Thirteen trainees in Occupational 
Therapy were advised to drop the program. After 
the students were counseled, a case summary of 
student was written. 
шо? effectiveness of these Дата мав also = 
when imminent and probable failures made goo 


progress after they were counseled. 
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Conclusions 


From the analysis of the data collected, the 
following conclusions seem warranted: 


1. The rating scale does not contain the most Е 
important traits essential for success in ther 
apy, and the right things are not being judged. 
There is too much emphasis on the individu- 
al's personality, and not enough factors which 
are more concerned with the success of the 
student in tnerapy. 


2. The various rated factors are not weighed 
properly in the total evaluation. 


3. The raters are not able to discriminate enough, 
perhaps because of insufficient contact with 
the student, or because the traits rated are 
not defined adequately, or because of inabil- 
ity to actually recognize traits, or lastly, Рё 
cause of the influence of personal bias, the К 
halo effect, and the error of lenience ог 56У 
erity. There may have been some hesitation 
to give ratings at the extremes of the scale. 


4. Some of the traits in the scale are not amen" 
able to rating. 


9. There was only one total measure which had 
a significant correlation with the ratings: 
This was the predicted grade point average: 


6. The low correlations of the tests with the rat- 
ings and the rankings seem to indicate tw 
possible things: 


al- 
а. The rating scale does not give а good М 
uation of the student as а therapist, an 


y 
b. Some of the tests chosen may not be Jae г 
ly or highly related to success in (һегар 


+ From all indications, the predicted grade | 
point average, the actual grade point aver 
age, the two intelligence tests (Wechsler ) 
Bellevue and the California Mental Maturity 
and the achievement tests (the Wide Range m 
Achievement and the Speed of Reading) вее“ 
to measure the same things and have hi£ 
correlations. Through more study опе ue 
find these instruments to be appropriate 00 
to use to predict success in therapy. HT 
claim cannot be made here that these me? 
ures should be used in future research be 
cause of the high correlations. 


The Kuder Preference Record and the рег” 
Sonality tests (Multiphasic Personality ар 
tne Social Adjustment Inventory) measure 


E MÀ X, — тете 
— .. б рн 
= — l— — —amaÇ 
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10, 


1. 


12. 


13, 


14, 


many amenable and fine traits of the individ- 
ual. There appears to be little relationship 
between these tests and the rest of the bat- 
tery. Again, the claim should be made here 
that the low correlations and intercorrela- 
tions of tnese instruments with other meas- 
ures has nothing to do with the value of the 
tests in predicting success in therapy. 


. The Manipulation Test correlates fairly well 


with the other measures and with the ratings, 
which substantiates the statement and con- 
clusion that the instrument should be used in 
future research from which to predict suc- 
cess in therapy. 


The Pegboard Test, the Paper Form Board, 
the Mechanical Comprehension scale, and 
the Practical Judgment instrument showed 
little or no relationship with tne ratings, or 
With the rest of the tests. These instruments 
may be or may not be appropriate ones from 
Which to predict success in therapy. Since 
Hiroe of the rating scale have been е5- 
Ablished it is proper to reserve for future 
research the status of these four instruments 
In the present battery. 


ue two part scores showed any relation- 
hip with the ratings. These were the Hap- 
poem Score and the Truthfulness score on 
€ Washburne Social Adjustment Inventory. 
he low correlations of all the part Scores 
With the ratings may be due to one of three 
things: 


à. Not enough cases were available. 


b. The tests may not be appropriate ones 
Írom which to predict success in therapy. 


“Тһе rating scale does not give а good 
€valuation of the student аз а therapist. 


Not enough cases were available for having 

wirrelations of the part scores of the te sts 
ith the instructor's ratings, therefore, the 

Tesults did not seem to merit further analy- 


S А 
15 with the rating scale. 


Because of the small number of cases, and, 
E because of a lack of significant correla- 
sg the multiple correlation technique was 
9t useful, 


а value of the guidance program in theDe- 
rtment of Physical Medicine was almost 
Olly dependent upon the effectiveness with 
angon the results of tne tests, the ratings, 
Pertinent information from the data form, 
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15. 


16. 


TA. 


18. 


19. 


20. 
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were used by the faculty and its staff. The 
data were used wisely and properly by the 
Department in counseling the good, fair, and 
poor student and trainee according to her in- 
terest, intelligence, aptitudes, personality, 
judgment, and level of achievement or attain- 
ment. 


The Department of Physical Medicine real- 
ized that ii it is to do an effective job of se- 
lection and guidance of its students, the fac- 
ulty must be provided with dependable, mean- 
ingíul, objective and subjective, and accur- 
ate iniormation about each individual. The 
faculty members realized they must be thor- 
oughly informed concerning the meaning and 
uses of this information. 


Unless the criteria of success are clearly 
designated the evidence is quite meaningless. 


This study has been concerned with the sub- 
jects ior too brief а period (from three months 
to two vears). Unless information and evi- 
dence accrues from follow-up studies over à 
span oi years, the prognostic value of the 
measures used in this research is likely to 
remain unknown. 


To do justice to tne battery of tests used in 
this study more study and another experiment 
should be made with the tests in using the in- 
struments with a refined, revised, and im- 
proved rating scale which measures success 
in therapy. 


No test of this battery or any combination of 
tests in this battery measured all of the ob- 
jectives set out іог in measuring appropriate 
traits for success in therapy. Nor did it 
weight those it did measure the same asthose 
concerned. This was clearly understoodand 
accepted because no instrument is perfectly 
valid even for the purpose for which it is de- 
signed. 


The low intercorrelations of the instruments 
with other measures has nothing to do with 
the value of the test in predicting success in 
Occupational Therapy and Physical Therapy 
It may be the best measure of the battery. If 
it does not correlate with success in therapy 
then it should be discarded. 


Recommendations 


The foregoing findings prompt the author to 


recommend се ат matters for further investi- 


gation and study. 


Consideration should be given 
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this program should be adopted by other 
Schools in the country in selecting their phys- 
ical therapy and occupational therapy students. 


to the following problems: 


1. A job analysis and a job specification of both 


a physical therapist and an occupational ther- 
10. A cumulative record should be constructed 


good therapist. ful form the data received by the Department 
on all of its students from the test results, in^ 
2. The present rating scale should be revised terview, data form, and other effective tech- 
and improved so that every factor essential niques of guidance. 
u in therapy is in З - 
Са ae ita Битен =a fac 11. The Department of Physical Medicine should 
arrange with every student of therapy a рге- 
3. The following measures should be givenmore Bas iere and a post-test interview. Un- 
investigation and experimentation before be- di uch an arrangement the students шау | 
ing replaced by instruments which will meas- 15си55 their whole program prior to and af 
ure the same things as the other ten meas- ter an appraisal and an evaluation has been 
ures: The Mechanical Comprehension Test, made. Negative guidance, drop-outs, and 
the Practical Judgment, the Paper Form maladjusted cases can be decreased if the 
Board, and the Purdue Pegboard. EM have this faculty-student relation- 
ip. 
4. The following ten instruments shoul 
in oe d research because they и Needed Rumi 
Some degree success in therapy: = Е 
sler-Bellevue Intelligence Scale, ae ; Several studies need to be made in this exper" 
fornia Mental Maturity, the Wide апке imental and developmental area of the selection 
Achievement, the Speed of Reading, the Mul- of students for the Department of Physical Med- 
tiphasic Personality Inventory, the Washburne icine. As research in prediction and selection 
Social Adjustment Inventory, the Rate of Man- for college and vocational success now stands | 
ipulation Test, the Kuder Preference Record there is a definite need for research study in this 
the predicted grade point average, and the і ОН study-with: 
actual grade point average. , 
1. More valid and reliable measures of factors 
5. Since there was little correlation between the that seem to play a large part in the success 
tests and the rating scale it is necessary to of the individual in physical therapy and occu- 
change the rating scale, or revise the pres- pational therapy. 
ent battery of tests, or develop a group of in- 
struments which will correlate, 2. Studies for the factors and of the factors that 
enter into Satisfactory occupational adjustmen 
6. Some parts of certain tests seem to be more as well as educational, personal, and social 
accurate in recognizing the successful stud- adjustment of the occupational therapist and 
ents than others. This should be investigat- physical therapist. 
ed more fully with a larger sampling of train- 3 
ees. . А comprehensive follow-up study over a per^ 
lod of years of the criteria used in the selec” 
7. The Department of Physical Medicine should tion of students in Physical Medicine. 
develop as soon as possible tests on the re- з 
finement of motor ability and patient-therapist 4. Siener investigation required to ascertain the 
relationship. Considerable attention should rated t X of the numerous characteristics 
be given to the refinement of available per- 0 the therapy student's total adjustm en 2 
sonality measurements in approaching the 5. A1 E Бе 
werd of a patient-therapist test. in келіннің, job specification, a job дезо” 
pational Ps instructional analysis of the ос 
8. This experimental study should be continued the facult erapist and physical therapist РУ ays" 
until sufficient criteria are established for ical Fn gia pers of the Department of пай 
a successful program in selecting students m expéttad cÉ The faculty members know 
for Physical Medicine. а good therapist. 
6. 


apist should be made by the faculty members 
of the Department of Physical Medicine, so 
the raters will know what is expected oí a 


Since selective devices are necessary for the 
selection oí students in physical Medicine, 


by the Department of Physical Medicine 50 
that it may include in composite and meaning 


A reconstructio: i 
Е n ог revision of the present 
due Scale so that it includes all the factor? 
at make for success in therapy. 


OOO —— a. as. 


June, 1957) 


10. 


11, 


12. 


13 


14. 


« Barr, A. S. 


Й Веаг, Б; M. 
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APPENDIX A 
THE STATISTICAL ANALYSIS PROCEDURES 
Statistical Analysis 


The chief problem of prognosis to which research workers have given attention is the question of the 
predictive value of proposed measures. In treating any research relative to vocational success, pre- 
diction, and educational and vocational achievement, it is necessary to note certain matters pertaining 
to the meaning of test scores, the techniques of investigating the predictive value of measures, and the 
Procedures for making predictions. 


A. Meaning of Scores 


. Test scores are usually first expressed in terms of raw scores which in and of themselves аге mean- 
ingless. А score of 145 on the Wechsler-Bellevue Intelligence Scale, for example, cannot be interpre- 

ted unless some additional information is given. It may be the lowest, the highest, orany score between 

two extremes for a particular group. Raw scores derive meaning through various forms oi transmuta- 

Hon They may be interpreted in terms of ranking whithin a group as the first or the fifth in a group of 

wenty. 

More Írequently the percentile rank is used, which indicates roughly the percentage of the grouptnat 
falls below a given score or the position within a theoretical group of 100. Thus a percentile rank of 60 
reveals that 60 percent of the group have lower ratings. 

Scores derive meaning from coarse descriptive scales, for example, the Wechsler-Bellevue Intelli- 
Бепсе scale has categories such as genius, superior, excellent, above normal, normal, below normal, 
and so on down the scale. Other forms of derived scores include age score, grade score, standard 
Score, and the T-score. 


B. Coefficient of Correlation 


fi “The basic concept which has made prediction possible and which is the basis for evaluating the ef- 
1Сіепсу of prediction is that of correlation. By correlation is meant the relationship existing between 
capacities, traits, abilities, aptitudes, or various mental and physical functions. For example, in guid- 
ance it is very important to know as clearly as possible the relationship between the predictive item s 
апа the success criteria. This relationship is indicated best through the correlation coefficient r. The 
„еагвоп product-moment г is the best expression of this correlation. Its use is subject to certain lim- 
‘ations, For instance, this r should be used only with linear or fairly linear data and with data which 
may be considered continuous. ” (5) | | 
In the analysis of the data in this study the Pearson product-moment r is used. The correlation co- 
efficient changes in value from +1. 00 to -1.00. Тһе +1. 00 indicates a perfect positive relationship and 
| : 00 indicates а perfect negative relationship. Practically all coefficients with educational and psycho- 
Bical material will be found to be significantly less than these two extremes. | 
- By the fact that the correlation coefficient is used to show this prognostic relationship, it is not im- 
РЦед that this is the only method showing the relationship. It is, however, the one most commonly used 
Опе which is the best expression mathematically to show the relationship. "E 
“Тһе general form of Pearson's product-moment coefficient correlation for deviations from the true 


Mean 15 
ps Ria. 
Nia 
ame “т is the coefficient correlation; x,, хг, is the summation of the rir б з wo s of 
T iati the x, and x, distribution: 
ang еавоге from their true means; , and г are the standard deviations о: 1 г distribution; 


is the number of cases used. " (103) 


C. Standard Error and Probable Error of the 
Coefficient of Correlation 


The formula for the standard error of the coefficient of correlation is: 


гі з 117212. 
Ум 
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or when N is small 


is is ti used when one wishes to test the null hypothesis, that is, to test the probability 
of Ыз рис е of correlation by chance if the true correlation is 0. нн ee 
be twice the size of its standard error in order to be significant at the 5% level. This means tha ie 
are only five (5) chances in one hundred of obtaining as large a correlation as that obtained НЕ eye 
fluctuations in sampling. This procedure is not valid for high values of r even though the samp е. docs 
When the true correlation approaches «1.00, the Sampling distribution of the r's obtained even ie As 
large samples will be markedly skewed, and any interpretations of the standard error based on 
mal probability integral table may be very seriou 


Sly misleading. 
The probable error о the coefficient of correlation will therefore be: 


2 
Р.Е. r12=.6745 1-г 12 
VN 


“и, for example, a correlation coefficient of . 58 is obtained between two measures using 90 cases 
the P. E. will be equal to: 


.67451- (.58)? _ 05 
Y 90 


and 


This indicates that the chances are even that a 
other correlation coefficient is calculated upon 90 cases drawn from the same population as the eT 
drawn that the coefficient of correlation will not Vary more than five points lower or higher than .58. ( 


D. Coefficient of Multiple Correlation 


қ А Б ше қ А ues 
The multiple correlation coefficient is the correlation between observed values of one trait and les 
of that trait estimated by a re i It may haveany V is 

between zero and +1 rtial r's involved 


APPENDIX B 


THE RATING SCALE 
Nature of the Rating Scale 


15, persons, personalit 
veniently classified into three categories: rating s 


n 
y traits, attitudes, and the like may lec 
1 ) cales, rank-order method, and paired-compariso 
method. Of these, the rating scale is most frequently used and applied in educational investigations. 
Research findings have been reported for the following problems: 
(a) What traits are most amenable to rating? 
(b) What number of scale steps or points can most obse 
ratings? Р 
(c) What types of rating Scale аге most valid and reliable for various educational purposes? пъ 
(d) What is the effect upon ratings of the influence of over-and-under estimation, central tende 
halo effects, and logical error? 


гуегв discriminate in making the usual 
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The author has not attempted to review all Ше numerous studies that concern ratings, as this would 
require a volume in itself. We have selected a few which are illustrative of the method. 

Adams, Furniss and De Bow (1) have done one of the most thorough and careful rating studies. Stu- 
dents were rated on 63 traits by ten or more associates. Traits showing a second-rating reliability of 
less than . 70 were discarded from the study. For an Intelligence test the Army Alpha was used. The 
average correlation of grades with the ratings was much higher than the average correlation of the in- 
telligence test with the ratings. 

Pressey (83) found a correlation of . 69 between ‘school attitude" (industry and application) and school 
marks. Тһе same ratings correlated . 55 with intelligence. Estimated ‘‘mental ability" correlated with 
Srades .81. Sangren (92) had teachers rate their students on ‘‘scholarship qualities” (methods of work, 
application, industry and attitude, assimilation of new ideas), and correlated the scores with grades. 
The Coefficient was .93. Inasmuch as the above factors are the prime determiners of most teacher’s 
marks, the correlation should have been . 99. 

Fish (26), in а study of Wisconsin sorority women, found that the correlations of grades and rated 
Personal characteristics was very low. The rating method used required that each rater rank the en- 
tire group, from first to last, thus eliminating the tendency to give too high ratings, etc. The students’ 

nor points correlated as follows with the five traits rated: nervousness, -11; optimism, .28; indus- 
try in Study, .38; physical activity, .28; leadership, . 14. 

_ These studies show that ratings can be used or misused, according to the amount of care exercised 
With the rating technique. We cannot emphasize too much the pitfalls into which the user may stumble. 
Many Studies report correlations with ratings of personal traits which are terribly high; for instance, 

ebb (114) found a correlation between marks and ‘tendency to do kindnesses on principle" of . 98. 

1S means that the rater simply identified the two characteristics. 

А trait is considered amenable to rating when competent judges (raters) tend to agree in their eval- 
uations, Although verification is needed, findings from several studies indicate that some traits are 
„оса amenable to rating than others. Hollingsworth (48) found close agreement among raters upon such 
кр ав efficiency, originality, perseverance, quickness, judgment, clearness, energy and will. There 

15 fair agreement upon mental balance, leadership, intensity, reasonableness, independence, and 

Убісаї health. There was poor agreement upon such traits as courage, unselfishness, integrity, со- 
прегайуепезв, cheerfulness, and kindness. Shen (97) reported the best agreement upon Scholarship, 

a dership, intelligence and the poorest upon punctuality, tact, and judgment. Miner (70) found high 

Éreement for such traits as leadership, generalability, reliability, dependability, and sense of humor. 
d “The bossibility of satisfactory agreement among judges appears to depend upon: (a) an adequate 

efinition So that the judges are in agreement in regard to what is being rated, and (b) frequent оссиг- 

°псе о that the judges can observe sufficient samples of behavior. When Ше following traits are ad- 

equate]y defined and observed over a sufficient period of time, they are amenable to rating. They in- 

clude; efficiency, originality, perseverance, quickness, emotional stability, interest, health, punctu- 

ality, leadership, scholarship, and intelligence. Such traits as courage, unselfishness, cheerfulness, 
ness, judgment and tact have not been found amenable to reliable rating. " (30) 

in оо Set rule can be laid down for the number of steps or units оп а rating Scale. Too few steps result 

N Coarse ratings because the observer is not given opportunity to exercise fully his powers of discrim- 

tation, and too refined a scale makes it difficult for an observer to discriminate between one step and 
next, 

Сопки ed “that the maximum number of steps would be five for a single 
mae w е ied ppc Ms and nine for a double scale which extends through zero 

Opposite iti the extremes of the scale. '' | | | 
the monds ( 104) maintains that the degree of reliability one wishes si rin Se 
lea, matter, He concluded that for rating human traits seven is the optimal number. 


to an appreciable loss in reliability. 


y 
Pes or Rating Scales 


There are five major types of rating scales: 
1. A number of phrases descriptive of varying degrees of a trait p эшсез н er Ж 
Order form a descriptive rating scale. In using this scale, an o 
best describes the individual being measured. 
opriate positions under 2 straight line, the instru- 
cale used in this study is of this type. ) 


2. If the descriptive phrases are printed at appr 


Ment is called a graphic rating scale. (The s 
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3. A product scale consists of a series of products, e.g., specimens of handwriting, arranged 
а PEOCUGUISCALE ^ 
according to values determined by a group. 


i i ipti Г persons, each of which is 
an-to-man rating scale consists of descriptions of a number oí p б : 8 
E dem to the user of the scale. This instrument has been widely used by the United States Army 
for rating officers. 


9. А numerical rating scale, frequently called a score card, consists of a number of items (char- 
| acteristics), each of which has been assigned a numerical value. ” (71) 


Freyd (29) concluded that the graphic type of rating scale is the most satisfactory. He listed vore 
aladvantages of this type of rating scale such as “simplicity, comprehensibility, ease of administr Ñ 
tion, freedom from direct quantitative terms, and ratings as finely discriminated as the rater chooses. 


Reliability and Validity of Ratings 


d. Rugg (90) recommends the use 


of the pooled ratings of not less than three independent judges; Symonds (104) recommends eight judges; 


and Bradshaw (9) from five to twenty-two judges. No one formula will apply to all situations. Furfey 


(33) has shown that the reliability of a rating may be increased by subdividing a trait into a number of 
subtraits and asking each judge to rate the subdivisions. 


Cause of Errors 


The types of errors which limit both the reliability and validity of ratings are: 


1. The error of lenience, or severity, 


- 
that is, rating all individuals too high ог too low (frequen 
ly referred to as “personal аз’ 


or “personal equation’), 


2. The error of central tendency, or hesitation to give ratings at the extremes of a scale. 


3. Halo effect, or the 


general mental attitude toward or general impression of the person ог ob- 
ject being rated. 


4. The so-called logical error which comes from pre-suppositions in the minds of raters and lack 
of definiteness of the trait rated. 


Personal bias in rating, such as a rater’ 
trait, introduces a systematic error. Conr 
not important in correlation studies, but in oth 
ence the findings. Guildford (40) proposed a f 


Ratings of the so-called “traits of character”? or of personality traits of therapists are likely 10 in д 
volve а halo effect. Newcomb (73) pointed out a so-called logical error, attributed to logical presuP. кй 
sitions іп the minds of the raters. This may be mitigated by calling for judgments of obviously obser 
able actions rather than for abstract traits which may overlap, 


Concluding Statements 


The application of rating methods should be confined to tr 


; f trait? 
aits amenable to rating. The rating O 
which are inferred from behavior should be based upon syst, 


Қ iod. 
ematic observation over an extended регі 


| 
| 
| 
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More precise and objective definitions of traits should be provided. Single ratings should not be used 
ав measures of human qualities because sufficient reliability is usually obtained only when a composite 
of from five to ten independent observations are obtained. Practice in the use of a rating method will 
increase the reliability of the measures. So far as possible, bias should be eliminated from ratings. 

For certain characteristics, such as personality traits, the rating scale has a definite place, but it 
is subject to errors and biases. As it is commonly used, it is heavily dependent on memory. Other 
difficulties arise in getting raters to agree upon the meanings of items as well as the degree of their 
presence in the situation or individual under observation. Rating scale techniques have been refined in 
the past through research. It is reasonable to expect that the rating scale will continue to be refined in 
the future. 


APPENDIX C 
DATA FORM 


Tests and Their Uses 


Tests are concerned with specific aspects of the individual, such as intelligence or mental ability, 
Personal judgment, mechanical aptitude, interests, school knowledges, and the like. They should only 
© used when their administration and scoring can be done with competence. They must be used with 
саге ала regarded as important tools in the guidance process, but not substitutes for it. No single set 

of tests will solve all the problems of the guidance counselor. ЗЕ 
Test may function in a number of ways as aids to counseling. They may be used to a limited extent 
both negatively and positively as instruments of prediction. If the counselor can determine what ап in- 
lvidüal has done on this or that test, he can then turn to tables of probabilities, and tell him that his а 
слапсев of, say, graduating from college, or of learning Ше rudiments of electrical work, are practic 
ly nil. On the other hand, he can use test results positively and point out that, in the light of the coun- 
Selee's demonstrable aptitude in certain areas of endeavor, he may choose from а whole range of job 
9Pbortunities that fall in these fields, with a high probability that he will succeed in any of them provid- 
his inter i k еее ( 
‚ Tests езі кі. УР devices. A counselor may discover that an individual has defin- 
= aptitude for a certain vocation but apparently lacks special training for it. The question then arises: 
What are the inadequacies in this individual’s program as it has developed up to this time? Diagnostic 
testing will Елеу agaist the counselor in answering this question, and thus enable the individual to 
aximize the training that he has had up to that time, and to concentrate upon the things he А їо 
Now ог do in order to develop any special competence needed to assure job success. Certain ests have 
А Subsidiary purpose in this connection. The instructional test, for example, can be used to indicate 
0% well an individual can learn by himself. This information is important for the counselor to know 
before he can make any recommendation to an individual being counseled about advancing his education. 
Tests should be looked upon as supplementing each other and the counseling те е зно take 
“Ch test result and interpret it as if nothing else were known about the individual. 1 55 5 ons е con- 
Білегед in relation to each other —which is why the ‘‘ргоШе’” is so important in the interpretation of 
test results. A selor must get a great deal of practice with ‘‘profiles before he can make а reas- 
able interpretation of them. Experience enables one to better develop the ability to perceive the pat- 


е 
"05 that tend to emerge. 


APPENDIX N 


CASE SUMMARY 


Аве, Miss Jane Huston was born August 19, 1936, at Mauston, Wisconsin, and now is twenty-one 


Years of age. 
2 ing а School of nursi 
š Family Status. Jane is the oldest of four girls, two of whom pepe от е чын ты 
ЗПоШег doing office work. Jane has no brothers. Her father and m 
Zens who teach school in Milwaukee, Wisconsin. 


Healtn Status. At present her health is good. She had the usual childhood diseases, but there are 
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. Work history and odd jobs. Jane never пада 
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no evidences of complications or sequelae. 


School status. Jane attended the elementary and Secondary schools of Mauston. Three years ago 


i i i i i i Jane's 
he started at the University of Wisconsin as a freshman in Occupational Therapy course. | 
теретін average for three years is 1.2. In high school Jane ranked 24th out of fifty-eight students 


in her graduating class. 


ment tests are the 37th and 44th percentiles, respect 


Reading habits. Jane reported to her advisor, Miss Caroline Th 
| about two hours а day. Нег scores on the Michigan S 


ively. 


ompson, that she reads and studies 


peed of Reading and the Wide Range Achieve- 


. Extra-curricular activities. In high school Jane wrote for the monthly high school paper. She was 


active in dramatics. In college Jane engages in the social functions of the University Memorial Un- 


10n. 


remuneration for about three years. 


Intelligence 


Wechsler-Bellevue 


Score 
Verbal 91 
Performance 94 
Total 93 
California Mental Maturity 

Verbal 96 
Performance 99 
Total 98 

Achievement 
Wide Range Achievement Scale 

Reading 64 
Spelling 51 
Arithmetic 46 
Total 161 

Michigan Speed of Reading 42 
Interest 
Kuder Preference Record 

Mechanical 

Computational 

Scientific 

Persuasive 

Artistic 

Literary 

Musical | 

Social Science (Service) 

Clerical 


job. She did baby-sitting on weekends for moderate 


. Testresults. Her percentile rank in the Henmon-Nelson test was the 40th. 


Percentile 
41st 
42nd 
42nd 


45th 
48th 
48th 


48th 
36th 
34th 
44th 


37th 


42nd 
93rd 
17th 
38th 
25th 
5151 
88th 
47th 
91st 
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Special Aptitudes 
HET EUes 
Purdue Pegboard 


Right Hand 56th 
Left Hand 39th 
Both Hands 48th 
Total 46th 
Rate of Manipulation 
Placing 45th 
Turning 5151 
Mechanical Comprehension Test 34th 
Practical Judgment Scale 46th 
Personality 
Multiphasic Personality Inventory 
Cannot Say 50th 
Lie Score 54th 
F Score 50th 
Hypochondriasis 56th 
Depression 58th 
Hypomania 53rd 
Psychopathic -Deviate 56th 
Masculinity-Femininity 58th 
Paranoia 43rd 
Psychasthenia 37tn 
Schizophrenia 45th 
Hysteria 37th 
Washburne Social Adjustment Inventory 
Truthfulness 78th 
Happiness 76th 
Alienation 94th 
Sympathy 90th 
Purpose 87th 
Impulse-Judgment 93rd 
Control 89th 


Diagnosis and evaluation. Jane is a student of average intelligence. 


Her scholastic attainment is be- 
си ауегаве. She ranks below the median intelligence quotient of the 
е. 


234 students in Physical Medi- 


teg ie test results clearly indicate that Miss Huston is stronger in non-language factors. 

ing ты. and comprehension is low. In both achievement instruments Jane ranked below av 

Meqi 9 Vocabulary, The low percentiles reveal that she does not have the ability to read 
iterature efficiently and that her rate of reading is slow. 

ang e Profile record shows that Jane has little or no interest in the mechanical, Scientific, artistic, 

ti reas which is unlike the expected interest pattern of students interested in Occupa- 


Her speed of 
erage in read- 
Scientific and 


Onaj cial Service a 
Во — apy. 
Tane ғы; Personality measures administered to Jane found her as average. Her responses indicate that 
к Her г 2 ñormal personality. | : | 
94 о Profile of the special aptitudes shows that Jane has none of the special aptitudes and skills expec- 


Vem „6008 therapist. She had trouble with tip-of-the-finger movements, finger movements, and gross 
ents of the hands. 
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Recommendations 


Jane was administered some positive and sincere guidance by the Department of Physical Medicine 
after all this data was perused and discussed with Jane by her advisor, Miss Thompson. It was suggest- 
ed that she leave the Department because of low Scholarship, lack of special aptitudes, lack of or a 


= of interest, poor reading skills, and because of her interest in the clerical and computational 
ield. 


„Әль: ЗВАНИ. 
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TESTING THE ASSUMPTIONS UNDERLYING 
MULTIPLE REGRESSION 


FRANCIS A. C. SEVIER 
Glassboro State Teachers College 
Glassboro, New Jersey 


Introduction 
—— 


. THERE ARE, as all statisticians know, var- 
lous assumptions underlying the application of 
multiple regression techniques. However, men- 
боп is Seldom made by researchers who employ 
ese techniques as to whether their assumptions 
ave been tested. One must, therefore, take 
or granted, when reading such papers, thatthe 


researcher has cautiously analyzed each as- 
Sumption, 


Оле fie 


14 in which multiple regression tech- 
niques ha 


dich ve found wide application is in the pre- 
ction of academic success. In this field of ap- 
Mication more sins have been committed in the 
"e of multiple regression than perhaps any- 
чена else. This author, having become in- 
to s ша study of academic success, decided 
DR how well the data used in such education- 
Problems really fit the assumptions. 
to t е problem which was originally proposed 
hen author was that of predicting academic 
Чакы in the Colleges for Men at Rutgers Uni- 
Was | Y. Freshman grade-point average (X4) 
esr be predicted from the Verbal Aptitude 
сат ore On the College Entrance Examination 
tude examination (X1), the Mathematics Apti- 
Scho, st Score (Хо), and rank in secondary- 
lative Sraduating class (X3). Sophomore cumu- 
Фенер STAde-point average (X5) was to be pre- 
rank d from VAT score (Х1), MAT score (Хо), 
Braq in Secondary school (X3), and freshman 
rag, Point average (X4). Junior cumulative 
пор Point average (X6) was to be predicted 
Scho Score, MAT score, rankin Secondary 
Wen » апа sophomore cumulative grade-point 
age З 6. Senior cumulative grade-point aver- 
МАТ 7) was to be predicted from VAT score, 
ior с 800ге, rank in secondary school and jun- 
of ( Шабіує grade-point average. Problems 
Eress) type are readily handled by multiple re- 
троп techniques. | 
ly, bae Problem, when formulated mathematical- 
Comes one of writing the equation 


š inm s bug E 
Ub. I 
le 
Must a toa least-square criterion. (The bn 
Š Chosen in order to make the sum of the 


% 


T ^ 
tnotes will be found at end of article. 


squares of the differences between the observed 
and estimated values of Ха minimum.) Inthe - 
case at hand this is a matter of writing Yj (i = 1, 
2, 3,4), weighted cumulative grade average, for 
each of the six schools of the University, asalin- 
ear combination of the Xp (п = 3,4): VAT score, 
MAT score, percentile rank in secondary-school 
graduating class, and weighted cumulative grade 
average through the previous undergraduate year. 
This notation implies that n = 3, i= 1 isthe case 
of predicting freshman cumulative grade average, 
while n = 4, i= 2,3,4 are the cases of predicting 
sophomore, junior, or senior cumulative grade 
averages, 

From the foregoing it is evident that the com- 
plete solution would require four regression equa- 
tions for each of the six schools, or twenty-four 
regression equations in all. These twenty-four 
equations would permit the prediction of future 
academic status from VAT score, MAT score, 
percentile rank in secondary-school graduating 
class and current cumulative grade-point ауег- 
age. (All of these prediction possibilities, how- 
ever, arepredicatedon the assumption that vari- 
ous statistical significance tests will be met. ) 

Before a complete regression analysis can be 
performed certain assumptions concerning the 
original data must be made and, where possible, 
tested, viz: 


1. The Xp are fixed variates and may be 
looked upon as population parameters, 


2. For a fixed set of X’s, the Y’s associ- 
ated with this set are normally and in- 
dependently distributed. 


3. For any set of X’s, the variance of Y 
shall be the same (this is the assump- 
tion of homoscedasticity). 1* 


Another assumption which is not listed in the 
above three, but which is perhaps the most im- 
portant one in the regression analysis, must also 
be tested, viz., the linearity of regression of 
any Xn on Y or on any other X used па particu- 
lar regression equation. This assumption was 
tested by the familiar statistic n? (Eta Square). 
Assumption (1) is in the nature of a po Stulate 
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and must ре made in order to satisfy the require- 
ment of reliability of the Xy. Тһе first part of 
assumption (2) was tested by using the X?-test 
(chi square test) of normality. However, the 
normality of the marginal distributions does not 
insure normality in (2) unless regression is lin- 
ear and the condition of homoscedasticity is ful- 
filled. Hence, assumption (3) was tested by us- 
ing the procedure developed by Hartley for test- 
ing the homogeneity of variance. 

One remark on notation must be clarified, 
the notation (Xi, Xj Xk) is employed to mean 
that the variables X; and X; are under consider- 
ation for all students who completed the kth year. 
Correspondingly, (Xi; Xk) is employed to m ean 
that the variable X; is under consideration for 
all students who completed the kth year. 


Linearity of Regression 
a 1122-2222 


Since 216 zero-order intercorrelations were 
involved in the complete study, it was decided 
to choose a representative sample of correlation 
tables to which tests of linearity of regression 
could be applied. Inferences concerning the as- 
sumption of linearity of regression were made 
from the results obtained from this sample. The 


rationale for the selection of the sample was as 
follows: 


diuo, АВ combinations of the seven 

vari. involved in the study (Хі, Хо, Ха, X 

Xs, Xo, Ха) except (Xa, Xs), (X5, Xo) and (xg, 
X7) were considered; there were fifteen such 
combinations. That the regressions of Ха on X5, 
Х on Xg, and Х on Ху were linear could be 
seen from the correlation tablesandthe extreme- 
ly high values obtained for the correlation сое!- 
ficients: г > .88 in all cases. 

2. By inspecting the correlation tables for 
particular combinations of variables, for all un- 
dergraduate levels and admission categories 
(six schools of the University), it was found that 
families of tables corresponding to the fifteen 
combinations in (1) could be formed оп Ше basis 
of degree of linearity of regression. Thus the 
correlation tables were arranged in fifteen 
groups. 

3. One member of each of these fifteen fami- 
lies was selected at random. However, no dup- 
lication of admission category and undergrad- 
uate level was permitted so that a wide sa m ple 
could be achieved. 

4. Nine combinations of undergraduate level 
and admission category would remain untested 
by the above method; hence, the correlation table 
showing the most apparent nonlinearity, for each 

of these nine combinations, was chosento be test- 
ed for linearity of regression. 


The statistic Ez, (sample estimate of пух) was 
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computed for each of the twenty-four correlation 
tables. 

The null hypothesis, that the true regression 
is linear, was tested by comparing the computed 
value of 


for each of the twenty-four correlation tables with 
the entries in Snedecor's table for nj - b - 2 and 
по = М - b degrees of freedom (where М is the num- 
ber of cases in an individual correlation table and 
b is the number of arrays in the x-direction). А 
significant value of F indicated a significant de- 
parture from linearity. Only one of the согге- 
lation tables displayed a significant depar ture 
from linearity at the 5% level. 

Table I gives the summary data for the te sts 
oflinearity of regression. Since only one of the 
twenty-four correlation tables tested, (X1, X3 
X4) in the Bachelor of Arts program, showed а 
significant departure from linearity at the level 
indicated, the assumption of linearity of reg Г 57 
sion of any Xy on У or on any other X used in 


any regression equation in the study was consid- 
ered tenable. 


Normality 


In order to test the normality assumption, it 
was not necessary to employ Бо elaborate 2 
scheme for selecting distributions to be exam- 
ined as that used in testing linearity of r eg r icm 
Sion. The structure of the study reduces Ше 24” 
missible distributions for this test. For example» 
the marginal distributions of X2 in all correlati 
tables for a particular undergraduate level anda 
mission category are identical since the same 
grouping scheme was employed throughout the 
study. Hence, the 216 correlation tables reduce 
to 114 marginal distributions, nineteen for еас 
admission category. That this reduction in а4- 
missible distributions сап be made is appare” 
when it is recalled that four variables are in^ 
volved in the freshman year, five in the sopho- 
more year, five in the junior year, and five in 
the senior year for each admission category; an 
the grouping scheme is constant. 

In order that the normality of each of Ше 56У7 
en variables (X1, Хо, Хз, X4, Хв, Хе, Хт) could be 
tested for each admission category, it was de- 
cided to test all variables in the freshman ye a Г” 
the Variable X5 in the sophomore year, and all 
Variables in the senior year. Thus, the distr?" 
butions of X1, Хо, X3 and Хд were tested in t ne 
freshman year, the distribution of X5 in the SOP 
ошоге year, and the distributions of Xi, Xo Хз, t- 
Хв, and Ху in the senior year. In all, this amo 
ed to 60 tests of normality. 

The normality of a given marginal dis tribu" 
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TEST OF LINEARITY OF REGRESSION—STATISTICAL SUMMARY 


SEVIER 


TABLE I 


Admission 
Category 


Agriculture 


Bachelor of 
Arts 


Bachelor of 
Science 


Business Ad- 
ministration 


School оғ Ed- 
ucation 


Engineering 


Variables E? E?-r? 1-E n, ng F 
EA WU qe = l — == x 
(Хо, X4;X4) 1543 0483 . 8457 17 231 0.7759 
(X3, X5;X5) 1076 0314 8924 15 193 0.4529 
(Xj, хехе) 1455 .1014 18545 10 146 1.7330 
(X1, X3;X1) 0936 0779 . 9064 8 133 1.4281 
(Хі, X3;X4) .0816 .0418 9184 8 374 2.1271 
(Хо, Хв; Х5) .0888 .0289 9112 11 315 0.9078 
(X1, X5;Xg) 2124 0463 7876 11 237 1.3203 
(X1, X7;X7) 2261 0505 .7739 9 214 1.5527 
(X3, X4;X4) | .2736 || .0825 1264 18 — 211 1.3316 
(Xp, Ха: Хо) 1895 11018 .8105 14 168 1.5072 
(X5, X1:X6) 1258 10854  .8742 13 115 0.8643 
(Хз, X7;X7) 1835 0539 8165 10 105 0. 6930 
(X5, X3;X4) .0656 . 0503 9344 8 250 1.6812 
(X1,X5;X5)  .1297 .0708 8703 | 18 180 0.8140 
(X2, X6;X) 2036 | .1475 .794 15 118 1.4509 
(X3, X6:X7) 1844  .0006 .8156 10 105 0.0063 
(X1, X3;X4) 1143 0578 9422 7 109 0.9545 
(X1, X4;X5) 2004 | .1072  .7996 14 88 0.8429 
(X3,Xg:X—) | .2514 | .1394 | 17486 10 72 1.3406 
(X2, X7;X7) 1368 10685 8632 8 63 026253 
(Хо, X1;X4) 1945 0335 8055 15 192 0.5325 
(Xj,X3X5) 11990 |0397 .8010 15 163 0.5390 
(X3, X5;X6) 1508 .0820 .8429 10 137 1.3234 
(ху, Хот) 11048: .0562 | .8952 | 10 124 017187 


и 
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è M TABLE H 
. 
| VALUE OF х5 AND CORRESPONDING P FOR TESTS OF “GOODNESS OF FIT” 
OF THEORETICAL NORMAL DISTRIBUTION TO OBSERVED DISTRIBUTION 
=———— АН 
Agriculture Bachelor of Arts Bachelor of Science 

E oom ВОВА: 
Variable n Ж Р п хо P n ж Р 
(X9;X4) 8 9.94 .30>Р>.20 10 10.93 .40>Рр>. 30 10 20.49 .05>Р>.02 
(«ох») T 10.54 .20>Р>.10 12 5.78 .95>Р>.90 11 1.10 .80>Р>.70 
(Каха) 5 11.88 .05>Р>.02 5 37.04 P<. 001 4 30.08 p<. 001 
(X4;X4) 12 14.55 .30>Р>.20 13 18.35 .20>р>.10 12 21.20 .05>Р>.02 
(X5;Xg) 10 117.17 .10>P>.05 9 26.98 .01>Р>.001 11 8.08 .80>Р>.70 
(X5;X4) 8 8.80 .40>Р>.30 9 10.52 | 405р5.30 9 7.32 .60>Р>.50 
(X1;X7) T 5.96 .60>Р>.50 10 8.02 .60>Р>.50 8 11.65 .20>Р>.10 
(X3;X4) 5 13.21 .05>Р>.02 4 25.43 Р< 001 2 14.69 р<. 001 
(хе?) 6 39.26 Р< 001 т 26.03 Р<001 8 11.29 .20>Р>.10 
(x7;X7) 5 17.77 .01>P>.001 т 26.86 P<. 001 7 6.97 .50>Р>.40 


» _ Р E қ шина No 
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TABLE II 
(Continued) 
Business Administration Education Engineering 
n TRETEN RN 
R % P n ха P n жа P 
10 27.07 ..01>Р>.001 8 14.85 .10>Р>.05 7 8.29 .40>Р>. 30 
9 35.92 P«. 001 8 3.83 .90>Р>. 80 10 12.00 .30>Р>.20 
5 23.60 Р<. 001 4 7.48 .20>Р>.10 4 25.74 Р< 001 
14 10.87 . 70>P>. 60 9 19.93 .02>Р>.01 12 14.35 .80>Р>.20 
9 26. 82 . 01>Р>. 001 t 6.26 . 60>P>. 50 7 39. 86 P<. 001 
T 10.46 .20>Р>.10 7 4.14. .80>Р>.70 6 3.46 .80>Р>.70 
8 17.33 .05>Р>.02 6 4.88 .60>Р>.50 9 9.09 .50>Р>.40 
4 12.02 .02>Р>.01 3 8.91 -05>Р>.02 2 26. 38 Р< 001 
6 20.17 . 01>Р>. 001 4 6.25 .20>Р>.10 7 9.04 .30>Р>. 20 


5 18. 39 . 01>Р>. 001 4 2. 83 . 60>Р>. 50 6 13.33 .05>Р>.02 
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TEST OF HOMOGENEITY OF УАВІАКСЕ - STATISTICAL SUMMARY 


TABLE Ш 


Variables 


[C MENU 
MEME ТН =s „ш сы ыш кш ЫШ ш 


(Хъ хаха) 
(X2; X4;X4) 
(Хз, X5;X5) 
(Хз, хах) 
(X3, XjX4) 
(X4, X5;X5) 
(х5, Х;Х6) 


(Хв, Ха; Ху) 


School 


ollege of 
Agriculture 


Bachelor 
of Arts 


Bachelor 
of Arts 


Bachelor of 
Science 


Business 
Administration 


School of 
Education 


School of 
Education 


College of 
Engineering 
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13.26 


5.61 


33.03 


Р>.05 


P>.05 


P>. 05 


P< 01 


P>.05 
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tion was tested by fitting a normal curve to the 
data, using the observed mean and standard de- 
viation as estimates of the theoreticalpa rame- 
ters, and then computing the corresponding xŠ 
(chi square). The computed value of x3 was re- 
ferred to a probability scale with n =k - 3 de- 
Бгееѕ of freedom; (where К is the number of clas- 
Ses in the marginal distribution) to test the null 
hypothesis, that the deviation of the sample from 
the theoretical normal distribution was due to 
Sampling fluctuations. The following conditions 
had to be fulfilled in order to apply the x? test: 


1. No theoretical frequency should be very 
small. 


2. The number of classes Should not be very 
large. 


It was therefore necessary to pool, as is stand- 
ага procedure, the frequencies at the ends of the 
distributions so that no class had a theoretical 
frequency of less than five. (Cramér3 recom - 
mends pooling until the expected number in any 
class is at least ten. On the other hand, Coch- 
ran* has shown that, in some cases at least, 
numbers as small as “опе” may be permitted 
without Seriously affecting the validity of the 
test. It seems that pooling tends to increase 
the calculated probability, and hence to diminish 
the chance of rejecting the null hypothesis.) 

A statistical summary of the x? test for the 
60 distributions tested is given inTable П. The 
value, P, in Table П is the probability of obtain- 
ing a value of x? as large as, or larger than 
the observed ха. The hypothesis, that the under- 
Ying distribution is in fact normal, is to be re- 
Jected whenever P< . 05. 

With the range P<.05 assigned for rejection 
9f the null hypothesis the following observations 
Were made from Table I: 


1. The distributions for the variables Хі and 
Хо refute the hypothesis of normality in 
four of twenty-four tests; 


2. The distributions for the variable X3 ге- 


fute the hypothesis of normality in ten of 
twelve tests; 


- The distributions of the variables X4, X5, 
б» and Ху refute the hypothesis of norm- 
ality in eleven of twenty-four tests. 


ag, hus twenty-five of the sixty tests refute the 
the и. tion of normality at the 5% level. Since 
th n ndard error of estimate is dependent upon 
these Шашу assumption for its interpretation, 
tima, 2845 imply that the standard error of es- 


With © Will in any event have to be interpreted 
Caution 
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Homogeneity of Variance 


If the assumption of homoscedasticity could 
be justified, it would be possible to substitute one 
measure of error in place of the Several, numer- 
ically different, array standard deviations, Thus 
the present section is devoted to testing the as- 
sumption of homoscedasticity which may be stat- 
ed as follows: 

Suppose there are b arrays ina correlation 
table, in the x-direction, with frequencies №, Ко, 
55-3 Ng and variances 87, в5,.. y sb”, The hy- 
pothesis is that of = 05 =... = o? = 02, i.e., the 
b samples have been drawn from normal popula- 
tions having a common variance. 

Three tests exist for testing this hypothesis: 
the Ly -criterion, used by Neyman and Pearson); 
the Bartlett M-test6; and Hartley's? modification 
of the M-test. In the present study it was decided 
to use Hartley's test, since, as Johnson? points 
out, Bartlett's test is advantageous in compari- 
Son with L1-test when the sample size is larger 
than sixty and since further, Hartley's test is 
more convenient as well as more accurate than 
the M-test. Tables for Hartley's test have been 
compiled by Thompson and Morrington9, 

Since one of the conditions of Hartley’s test, 
namely the number of entries per array shall not 


distributions, it was decided to postpone the test, 
in the computational procedure, until the regres- 
Sion analysis had been completed. Of the forty- 
eight correlation tables remaining in the final re- 
gression analysis only four had marginal distri- 
butions fulfilling the aforementioned condition 
for the application of Hartley’s test. Therefore, 
in order to achieve a more representative sample, 
four additional Correlation tables were chosen at 
random from those remaining and the classes 
pooled to fulfill this condition of Hartley’s test. 

A statistical summary of the eight tests of the 
homogeneity of variance is given іп Table Ш. The 
value of P in Table III is the probability of ob- 
taining an M larger than the observed Mo. A suf- 
ficiently large Mo, one such that F<. 05, result- 
ed in a rejection of the null hypothesis of a com- 
mon variance. From Table Ш it is apparent that 
in seven of the eight cases tested, the hypothesis 
of a common variance was tenable at the 5% level. 
Hence, the condition of homoscedasticity was 
considered fulfilled. 


Summary 


The analysis shows that for data such as ver 
MAT score, and rank in secondary schoo 
рено class one must be cautious in applying 
Nit) regression techniques in the prediction 
of academic success. | | паруе 
ing assumption of linearity a 
зн be tenable, as does theassump 
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tion oi homogeniety of variance for the array 
distributions. Тһе normality assumption, how- 
ever, seems to be very much in doubt. Since 
the standard error of estimate is dependent up- 
on the normality assumption for its interpreta- 
tion, these results imply that the standarderror 
of estimate will in any event have to be interpre- 
ted with caution. 

Generally, these results indicate that more 
care must be exercised in employing multiple 
regression techniques than is currently the case. 
Since the analysis is based upon certain definite 
conditions or assumptions, it is imperative that 
these assumptions be analyzed. 
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THE INTERRELATIONSHIP ОҒ VOCABULARY 
COMPREHENSION AND RATE AMONG 
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DISABLED READERS 


JAMES C. REED and ROGER S. PEPPER 
Wayne University 


THERE HAVE been numerous scientific stud- 
les done to determine the nature of the reading 
act. Those investigations which have had as 
their aim the identification of parameters gov- 
erning reading have frequently employed factor 
analysis. Studies which have been done on col- 
lege Populations, such as those of Pankaskie (9), 
Davis (2), Langsman (6) and Hall and Robinson 
(4), to mention only a few, have identified var- 
lous facets of reading. The number of factors 
identified have differed according to the number 
and type of tests employed and the manner in 
which the factor analyses were carried out. 
However, there is general agreement that there 
Isa vocabulary component, a factor involving 
Comprehension of factual material, and one of 
Speed of comprehension. By and large, these 
and similar studies have been done on a “погш- 
al reader" population. The subjects used in 
these studies have generally not had reading dis- 
abilities. While the factors of rate, vocabulary, 
and comprehension have been identified, to the 
writers’ knowledge there have been no studies 
done оп а college population to determine how 
these variables interact among persons havinga 
reading disability. The reading clinician, how- 
ever, does not see normal readers; his profes- 
Sional concern is with the deviates andhe needs 
to know whether the factors which have been 
found to be present in reading Operate in the 
Same way for a deviate as they do for a normal 
reader. 


The Problem 
— а 


. There аге many ways of defining a reading 
disability. The reader is referred to any text 
Оп remedial reading (5,8, 10). However, it has 
br defined by some as a discrepancy between 
река E comprehension and silent reading com- 
n €nsion, and by some as a discrepancy be- 
Š еп scores on an arithmetic test and scores 

E Teading test. Others have stated that a 
lerene disability is present when there is a dif- 
Сара 0 between some measure of intellectual - 
ang о Such as the Stanford- Binet mentalage, 

г... measure of reading level. АП of the 
fest z lons subsume a disparity between mani- 
tenti eading achievement and an estimate of poe 

reading ability. For the purpose of this 


study, a reading disability has been definedas ex- 
treme differences among the variables of rate, 
vocabulary and comprehension when these have 
been measured by the same reading test. It has 
been assumed that if a person makes a high score 
on any of these three factors, he has the poten- 
tial ability to read well. One who Scores low in 
all areas is considered to be а poor reader, 
rather than disabled. An individual who scores 
high in all areas is said to be a good reader. IL 
is recognized that the foregoing definition оға 
reading disability, while methodologically sound, 
may have limited generality. Furthermore, a 
one-factor theory of reading is not a necessar y 
concomitant of such a definition, but there is at 
least the implicit assumption that a general fac- 
tor is present in reading. The problem of this 
investigation, then, is to determine the interre- 
lationship of rate, vocabulary and comprehension 
among groups defined as having а reading disabil- 
ity. These reading disability cases are compared 
with groups who read well and groups who r ead 
poorly. 


The Procedure 
— T -Wure 


The Survey Section of the Diagnostic Reading 
Tests by Triggs et al., (11) was administered to 
approximately 2000 Wayne University students 
enrolled in freshman English. Thistestis divid- 
ed into three parts: general reading, from which 
a rate score is Obtained, vocabulary and compre- 
hension. On the general reading section the stu- 
dent is required to read a story approximate ly 
1800 words long and answer 20 questions about it. 
A total of 15 minutes is allowed for this section 
and the rate of reading is determined by the num- 
ber of words read during the first three minutes. 
The vocabulary test has a ten-minute time limit 
and consists of 60 items. Each item is а defini- 
tion followed by five words, one of which is cor- 
rect, and the score is the total number right. 
The comprehension section has a fifteen-minute 
time limit and consists of four passages with five 
questions following each passage; but the compre- 
hension score is the total number correct on this 
Section plus the total number of qu €stions an- 
Swered correctly on the general reading section, 

Local percentile norms were established for 
the freshman English students of Wayne. The 
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80th and 20th percentile ranks were usedas cut- 
ting points. Subjects whose scores were at or 
above the 80th percentile rank were designated 
as high. Those whose scores were at or below 
the 20th percentile rank were called low. Three 
studies were made. For the first study, individ- 
uals were selected on the basis of their rate and 
comprehension scores. In the second study the 
individuals were chosen on the basis of their 
rate and vocabulary scores. In the third, the 
Selection was made according to the vocabulary 
and comprehension scores. In each study the 
individuals were divided into four groups: (1) high- 
high, (2) low-1ow, (3) high-low, and (4) low-high. 
А person with a high-high classification is at or 
above the 80th percentile on two subtests. A low- 
low is a person at or below the 20th percentile 
on two subtests. А high-low person is one with 
а score at or above the 80th percentile on one 
subtest and at or below the 20th percentile on 
another subtest. A low-high person is one with 
scores just the opposite of a high-low's. Per- 
sons in these last two groups, high-lowandlow- 
high, are defined as having a reading disability. 
The other two groups are the good and the poor 
readers with whom the disability groups are be- 
ing compared. 

From each classification, 25 persons were 
selected by the use of a table of random num - 
bers. N - 100 for each Study. In general, each 
of the studies used different individuals. How- 
ever, due to the random process of selection, 


some individuals appeared in more than one 
study. 


Analysis of the Results 


In each of the three studies, a two-way апа|- 
ysis of variance was used to determine the inter- 
relationship of rate, vocabulary and comprehen- 
sion. The effect of either or both of any pair 
of variables upon the variance of the third was 
studied. Determining interrelationships is also 
a problem for multiple correlation and multiple 
regression; however, these techniques would not 
be suitable in the present study. Due to the way 
in which the groups were classified, the margin- 
al distributions would not be normal, hence, dif- 
ficulty would have been encountered in making 
tests of significance had multiple correlation 
been used. That technique would be appropriate 
only if a random sample had been drawn from 
the entire population of N - 2000. 

Since each of the categories in the two-way 
classification is fixed, Model I is appropriate, 
and the proper error term is the within cells 
variance. That this is so can also be seen by 
examining the expected values of the Mean 
Squares. (For a discussion of Models inthe An- 
alysis of Variance, see references 1, 3, 7,12.) 
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The summaries of the two-way analyses are 
presented in Tables I, II, and III. The results 
will be considered separately for each analysis. 

With vocabulary the dependent variable F was 
found to be significant at the . 5% level for rate 
and significant beyond the . 1% level for compre- 
hension. No significant interaction was found. 

In the second study, with comprehension the 
dependent variable F was found to be significant 
between the 5% and Ше 2% levels for rate, and 
Significant beyond the . 1% level for vocabular y. 
No significant interaction variance was found. 

In the third study, where rate was the depend- 
ent variable, Е was found to be significant beyond 
the .5% level for both vocabulary and comprehen- 


Sion, and, again, the interaction was not signifi- 
cant. 


Discussion and Conclusions 
-- 59 апа vonciusions 


The foregoing results need to be interpreted 
cautiously. The various scores on the Diagnos- 
tic Survey Test are correlated postively. As Such 
the distributions of the Scores beyond the points 
of truncation may not be normal and heterogene- 
ity of variance may be present even though it 
was not detected by Bartlett’s test, An asymmet- 
rical distribution might be more likely to oc CUP 
among the groups classified as normal, that 15 
the low-low and the high-high categories, 25 
these are the tails of a normal distribution. The 
number of cases falling within the disabled cate- 
gories, low-high and high-low, was much fewer 
than in the low-low and high-high classifications: 
In fact, a total of only 26 out of the entire 200 
cases was found for the high comprehension-10W 
vocabulary group. Due to the positive correla- 
tion of the variables, coupled with the smaller 
population numbers of certain categories and the 
way in which the groups were selected, itis ро57 
sible that the assumptions underlying ап analysis 
of variance have not been met. However, а vis- 
ual inspection of the data did not reveal marked 
departure from normality. 

Under the restrictions of the previous re- 
marks, several implications can be drawn from 
the results. Of interest is the interpretation 0 
the insignificant interaction. In general, noD" 
Significant differences mean only thata specified 
hypothesis cannot be rejected. It may be that по 
differences actually exist, or it may be that, T 
to the power of the test, a specified level of 518 
nificance was not reached. In the situation 2 
hand, the insignificant interaction does not me 
that the two variables have zero correlation. Th 
fact that in each of the two-way classification 
Studies the main effects were all significant, wit 
one possible exception, shows that the variable? 
аге related. Consider the exact nature of t 


model: 64-6... като (ав)ц +5. 61119 
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TABLE I 
MEANS, VARIANCES AND SUMMARY ОЕ THE ANALYSIS OF VARIANCE 
ОЕ VOCABULARY SCORES 

Group n = 25 нон,% Ног, Тен, Ісі, 
Меап 49.12 42.80 35.24 82.24 
Variance 54.54 66.00 97.77 45.44 

Source of Mean Expected Value 

Variation df Square P of Mean Square 
Rate 1 542.89 -005 0? + 50 Eg? 
Comprehension 1 3733.21 <.001 02 + 50 xc? 
Interaction 1 68. 89 02 + 25 X(RC)? 
Within Cells 96 65. 94 


в? 
*Legend: H» 80 percentile € < comprehension 


E X 20 percentile г = rate 
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TABLE II 


MEANS, VARIANCES AND SUMMARY OF THE ANALYSIS OF VARIANCE 
OF COMPREHENSION SCORES 


Group n = 25 HvHr* Нн. LH, «Iss 

Mean 32.36 31.92 28.12 24.36 
Variance 12.82 11.83 33.84 24.99 

Source of Mean Expected Value 

Variation df Square Р of Mean Square 
Rate 1 110.25 <.05 02 + 50 ZR* 
Уосаршагу 1 870.25 <.001 ог + 50 EV? 
Interaction 1 68. 89 ог + 25 Z(RV)? 
Within Cells 96 20.90 


*Legend: H» 80 percentile 


L< 20 percentile 


V = vocabulary 


г = rate 


g2 
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TABLE III 


MEANS, VARIANCES AND SUMMARY OF THE ANALYSIS OF VARIANCE 
OF RATE SCORES 


Group n = 25 НеНу* 


Holy LeHy Loly 
Mean 76. 24 65. 88 65.76 58. 88 
Variance 172. 94 141.19 175.19 211.53 
Source of Mean Expected Value 
Variation df Square P 


of Mean Square 


Wo інн 


Comprehension 1 1557.61 <.005 92 + 50 ZC? 
Vocabulary 1 1509. 69 <.005 02 + 50 EV? 
Interaction 1 15.69 o? + 25 Z(CV)? 
Within Cells 96 175.21 


о? 
*Legend: H 2 80 percentile 


С - comprehension 


L« 20 percentile у 


lI 


vocabulary 
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the true mean of the ijth cell. Е.. isthe grand 
mean of the population. с is the deviation of 
the grand mean from the row mean (Є і - £.). 
B is the deviation of the grand mean from the col- 
umn mean (Б.)-Е..). «gis Ше interaction 
(&ij- $.j* £ `) and е) is the error component. 
Assume (a 8); (the interaction) is 0. The cell 
mean can be expressed as the sum of two parts, 
one due to the ‘‘row effect” and the other due to 
the “column effect’’, together with a constant. 
If the interaction were significant, it would mean 
that some combination of the two factors would 
lead to an unfavorable result, others to a favor- 


able result, as compared with the results calcu- 
lated from the row and column means. In gener- 
al, under Model I, when the interactionis signif- 
icant, there is not much interest in testing the 
main effects, although there is no logical objec- 
tion to doing so. When the interaction is 0, the 
effects of the two factors can be considered to be 
independent. 

Apply the foregoing discussion to the relation- 
ship of the variables being considered. It can 
be said, for example, that while comprehension 
and vocabulary are correlated, their effects on 
rate are additive since the interaction is not sig- 
nificant. At least, that hypothesis cannotbe re- 
jected. In other words, the mean rate score for 
the ijth cell can be expressed in terms ofa com- 
prehension effect plus a vocabulary effect and a 
constant. To be more concrete, under the as- 
sumption of additivity, persons who are high in 
both vocabulary and comprehension would be ex- 
pected to have a higher rate Score than those 
high in one and low in the other. 

If one is willing to assume а linear model with 
additivity, then the definition of а reading disa- 
bility as used in this Study appears to have some 
merit. For the purpose of Screening individuals 
for further testing or possible Short-term train- 
ing, the classifications as suggested may have 
use. Ап individual high in one reading skill but 
low in another will not only require less tim e 
than one who is low in all, but he wouldbea saf- 
ег bet for success. The latter, the “low-low’? 
individual, may be a poor reader, but doing the 
best he can with generally limited abilities. of 
course, with reading disability defined other- 
wise, he may be a severely retarded reader 
when his reading achievement is compared with 
his intellectual capacity, in which case he would 

probably require individual rather than group 
training. 

Under the same assumption of additivity, it 
can be said that improving skill in one area 
of reading may contribute to proficiency in an- 
other. There may be reason to doubt the oft- 
repeated statement to the effect that all reading 

skills must be taught. Logically, however, 
whether or not improvement is obtained in skills 
other than the one being stressed will depend on 
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the particular skill involved. Developing vocab- 
ulary may result in increased comprehension. 

However, rate training will probably not contrib- 
ute to vocabulary, although it may result ina 

higher vocabulary score being obtainedona timed 
test. 

To answer the original question posed in this 
investigation, the variables herein studied ap- 
pear to operate among reading deviates in the 
Same way as they do in a normal population. 
Furthermore, when two of the three variables 
аге used as a basis for classification, sub- 
jects who are high on both will be high on the 
third. Subjects high in one but low inthe second 
will tend to be higher on the third than those who 
are low in both. While rate, vocabulary and com- 
prehension are related, the Separate effects of 
ay two of them on the third appear to be addi- 

ive. 

Іп addition to the interrelationships as dis- 
cussed in the foregoing paragraphs, the follow- 
ing statements can be made about the variables 
themselves: 

Vocabulary— The score on the vocabulary test 
is affected by rate. It is a timed test and to com- 
plete it within the specified limits, one must pro- 
ceed at the rate of answering six questions a min- 
ute. However, judging only from the magni tu de 
of the differences among the means, it appears 
that the time element affects those with good com- 
prehension more than those with poor comprehen- 
Sion. The data suggest that for good comprehend- 
ers with a slow rate, the vocabulary score on this 
test may be an under-estimate of their actual 
Word power. On the other hand, for those who 
are low in comprehension the vocabulary score 
may be a valid estimate of their word knowledge 
regardless of rate. š 

Comprehension—Of the variables studied, this 
опе appears to be related only to vocabulary: 
True, F for rate was significant beyond the 5 
level, but it is not believed to be important. Сег- 
tainly, there is no important difference betw e en 
the means of the high vocabulary-high rate grouP 
and the high vocabulary-low rate group. Itmay 
be that there is Some small advantage for those 
who read rapidly іп that they can answer the ques- 
tions and have time to Check their work, but the 
time element on the comprehension section does 
not seem to matter greatly. As would be expect- 
ed, the comprehension Score is closely relate 
(0 the vocabulary score, and this relation s hip 
needs no explanation. 

Rate—Perhaps the most interesting finding of 
this study is the relationship of rate to the vari- 
аМев of comprehension and vocabulary. Since 
rate is so much a function of vocabulary and com- 
prehension, the question is raised as to whether 
it has a variance of its own. Perhaps the most 
important variables governing speed of reading, 
instead of lying in the Perceptual domain, can be 
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accounted for by such factors as rate of concept 
formation, organizational ability and general 
One may well wonder as to 
the justification of Such training devices as гела- 
ing films and tachistoscopes, The findings also 
Suggest that it does not appear Profitable to use 
rate asa measure of potential reading ability. 
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А QUICK AND DIRTY 
MATING MULTIPL 


METHOD FOR ESTI- 


E CORRELATIONS 


WILLIAM J. МООМАМ * 
USN Personnel Research Field Activity 
San Diego, California 


1. Introduction 
ec hon 


IT IS WELL known that the lower bound of the 
estimate of the multiple Correlation is the larg- 


equation or the maximum likelihood estimate of 
the multiple correlation. 

The purpose of this note is to report a рго- 
cedure which enables a quick estimation of the 


However, the procedure has been tried with веу- 


eral examples and, in most Cases, has provided 


Of course, Optimally, the real 
Value of the estimate provided here shouldbeas- 


The author realizes that the act of Showing 
that the method “works” with severa] sets of da- 
а does not Prove that it is “good” in general. 

OWever, it does seem to add some degree of 
Credibility to the Procedure and this type of infor- 
ation is, at present, the best available. It 

de 9 be emphasized that this empirical evi- 

tace, although encouraging, is not too substan- 

he and anyone who uses the method is advised 
regard his results accordingly. Inother words, 


the estimate is "dirty", but the degree of this 
dirtiness is unknown. 


2. Notation and Preliminaries 
—— Àreuminaries 


Capital letters, except for the symbols В and 
R, will stand for matrices or vectors. A and А 
will denote non-singular, symmetrical, s quare 
intercorrelation matrices. The elements of A 
are r(i, j); i, J=1,...,k where г(1, i) equals 1 and 
r(i, і) for ізі equals the product-moment согге- 


2 r(i, j)/kk-1. 
VET ,3/ 


Properties in all directions with respect to the 
primary principal axis of the ellipsoid. The щ- 
verses of A and 
C will indicate a vector consisting of one row 
and k columns. 
relations of the independent variables, x(i) апа 
Ше criterion variable, y. These elements are 
denoted by Ty) ен L... ‚К. The transpose of 


The maximum likelihood estimate of the mul- 
tiple correlation, i.e., R, is given $ Ше square 
root of Ше quadratic form СА с! ; that is 


(2) В = (СА-1с')# , 


The inverse of any centro-iso-symmetric matrix 
and, in particular А, has been given by Roy апа 
Sarhan (9). The main diagonal elements of А-1 
are all equal and may be denoted by € = Өе, and 


е Opinj f the author and are in по нау officisl; nor are they intended 
t nions expressed are solely those 0 з e 
of we, construed as Tepresenting those of the U, 5. Naval Personnel Research Field Activity or the Bureau 
“8val Personnel, 
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all non-diagonal elements are also equal andare 
denoted by h = -6г, wherer is defined by (1), 


(3) 9-1/-Pk-l m], and 
е=1+Е - Эт. 


3. Тһе Method and ап Example 


The procedure suggested here amounts tocal- 
culating T from A, finding the inverse of А, апа 
calculating 


(4) Е = (CAC È, 


То evaluate Ше procedure, we will compare В 
to R as calculated from (2). To illustrate the 
calculations, consider the following information 
which has been taken from unpublished data. Let, 


1.000 .183 «323 .246 
A= . 183 1.000 . 651 . 537 
т „328 . 651 1.000 . 623 
. 246 ‚ 587 . 623 1.000 
апа, 
C= Г. 281 .484 .303 - 393] 
4 


3 
In this К = 4 case, and because 5 > r(i,j)- 
і=1 ізі 


.183 + . 323 + .246 +. 651 + .537 +.623-2.563 
T = 2(2. 563)/12 = .427, 6-1/(. 573)(1+3(. 427))' 
= 1/1. 3070 = .765, and e = 1 + 2(. 427) = 1. 854. 
The value of g = бе is 1.418 and h = -0т = -.327. 
It is recommended that the arithmetic be checked 
at this point by determining if g + k-Ihr-1. For 
this example, 1.418 + 3(-.327)(.427) - .999 
which is satisfactory when rounding errors are 
considered. 


Therefore, 
1.418 -.321  -.327 „оў 
--ло |=. 327 1.418 -.327 - 397 
А =, 327 2.1227 1.418 -.327 
-.827, | -.327 -.327 1.418 


If the matrix multiplication indicated by the 
triple matrix product СА 1с", (4) is performed, 
we find R^- . 278197 so that R = . 527. The max- 
imum likelihood estimate given by (2) 13В=.540. 
So we see that in this case, the agreement be- 
tween R and R is quite good. 

The effort involved in multiplying CA-1C' can 
be reduced considerably due to the special char. 
acter of A-1. Note that in the process of multi. 
plying the ith column of А-1 by C, all elements 
of C except the element which occurs in the ith 


column, are multiplied by h. The element т the 
i"! column is multiplied by g. Therefore, if we 
sum up the elements of C, i.e., 


k 
EG = Ф, вау, 


and subtract out the ith element, we would have 
all the necessary values which need to be multi- 


plied by h. These can be listed in the vector D, 
where 


k 
(5) D-[,Zr(5y)-rü;y)] = [Фф - rü; y]; i1... 


Then, 

(6) R? = СА-1С' = [gC+hD]C' = ВС! 
where, 

(7) в- [gC + hD]. 


For the example, 
8С -1.418 [.281  .484 .303 .393] 
т " [.398 .686 .430 .557]. 
Stake 0 я ІДУ) = 1.461, the elements of Dare 


1.461 - .281 = 1.180,1.461 - . 484 = . 977, 1.461 


= -303 = 1.158, and 1.461 - .393- 1.068. We 
find 


hD = -.327 [1.180 .977 1.158 1.068] 


< [-.386 -.319 -.379 -. 349]. 
Using equation (7) 


B= [.012 .367 .051 .208] 


and R^ = ВС! = 278197, giving R = .527. Inad- 
dition to the computational check, g + k-Inr = 1, 
it can be seen that the sum of the elements of the 
соня EC, D, hD and B are respectively equal 
о gb, K-I, k-Ih$ and $(g«k-Ih). These checks 
Should be applied at the appropriate time in the 
Course of the computations. 

B was labeled as such because it approximate? 
the standardized maximum likelihood regressi? 
Coefficients which would be determined from 
equation BA = C by the equation B = CA~!. 
value of B, for this example is 


B= [.207 „457 -л99 .220) 


Ex- 


This vector does not compare well with B- erel- 


регіепсе has shown that unless the r(i, j) ar 
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TABLE I 


THE VALUES OF R AND R FOR DATA FROM SEVERAL PUBLISHED SOURCES 


-X 


Value of 
Source of Data k R R | R-R] 
Kelly (5) 3 .51 .52 .01 
Mahalanobis, et al. (6) 3 „31 „82 . 01 
бпедесог (10) Е 3 . 14 . 74 . 00 
Tate (11) — 3 « 73 . 2 .01 
Walker and Lev (13) 8 -66 . 68 . 02 
Griffin (2) == 4 « 76 . 78 . 02 
Guilford (3) 4 70 „па 201 
McNemar (7) 4 „74 72 .02 
Peters and Van Voorhees (8) 4 „73 „79 .06 
Johnson (4) 5 70 . 90 20 
Waits (12) 5 .50 .50 .00 
Wert, etal. (14) 5 .44 238 . 06 
Greenberger and Ward (1) 20 .40 . 43 . 03 
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atively homogeneous, and therefore А isa good 
representation of A, the B and B vectorsare not 
particularly equivalent. Тһе values of R and R 
have appeared to be much more com patible. 
This is apparently due in part to the ‘‘averaging 
effect" produced by ‘‘errors’’ in the elements of 
B counterbalancing each other in the evaluation 
of R? - BC'. Even though B may not agree pre- 
cisely with B, it may prove a useful sta rting 
point for methods such as the one given by Green- 
berger and Ward (1) for finding B by iteration. 
In passing, it is interesting to note that when 
К = 2, R will exactly equal В and B will exactly 
equal B, since T is equal to r(1,2). Also, for 
an experienced operator, who knows the proced- 
ure, it takes about two minutes per independent 
variable to compute R if A and C are given and 
an electric desk calculator is available. 


4. Other Evidence 


The procedure has been applied to data taken 
from several textbooks and published arti cles 
which deal with statistical methods or research 
data. These examples have been selec ted be- 
cause the data were expressed in term s ог 
product-moment correlation coefficients. This 
method of presentation was most useful forthe 
application of the method Suggested here. The 
results of the applications of the method appear 
in Table I. This table presents the source of 
the data, the number of independent variables, 
the values of R and R and their absolute differ- 
ence. 

Only for the example given by Johnson (4) 
was R in serious disagreement with R. Scrutiny 
of the correlation data given by Johnson will 
show that the independent variables cannot be 
represented very accurately by a five- dim en- 
sional centro-iso-symmetric matrix with an 
T - .293 and so we should not expect very good 
agreement between R and R. This particular ex- 
ample was included to caution the reader that the 
method should not be applied indiscriminantly, 

The problem of determining whether or not 
the method can profitably be applied to a set of 
data depends, of course, upon the character of 
A and C and the value of k. The use of the mean 
deviation of the r(i, j) suggests itself as a possi- 
ble way of obtaining a quickly determined esti- 
mate of whether A can be adequately represent- 
ed by А. The more homogeneous are correla- 
tions in A, the better A can be represented by 

А. Other factors neglected in this evaluation 
are the “pattern” of the r(i,j) and the r(i;y), 
These are as relevant as the magnitudes of the 
r(i, j) themselves and probably account for the 
fact that the | R-R| have not appeared, in the ex. 
amples on which the method has been tried 50 
far, to be very related to the mean deviation of 
the r(i,j). It is with considerable regret that 
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guidance as to whether or not the method is use- 

ful for any particular problem must depend upon 

the user's judgment as to whether or not A is ad- 
equately represented by А. The numerical ex- 

amples show that considerable latitude in the de- 
Cision is permissible, but caution must be exer- 
cised in doubtful cases. 

From the results of examples worked from 
the published and other unpublished data, itis the 
author's judgment that the method holds reason- 
able promise for quickly providing a good esti- 
mate of multiple correlations providing that the 
r(i, j) are not extremely heterogeneous. 


9. Summary 
— су 


А procedure, which is arithmetically simple, 
has been given for the purpose of providing 4 
quickly obtained estimate of multiple correla- 
tions. It has been empirically shown that the esti- 
mate provided by the procedure is ‘‘practically 
precise, in respect to the maximum likelihood 
estimate, in most cases. The user is cautioned 
that the method does not take into consider ation 
the “pattern of the intercorrelations among the 
independent variables, but merely utilizes their 
average value and their number. Other things be- 
ing equal, it is expected therefore that the meth 
od becomes less exact as the heterogeneity of the 
intercorrelations among the independent var!- 
ables increases. The method was applied to 
Several sets of published data and the results of 
these applications are presented. They general- 
ly indicate that the method is practical in the 
Sense of providing estimates which are BERI, 
equal to the maximum likelihood estimates of mu 
tiple correlations. Statistical evidence relating » 
to the mean and precision properties of the 506 
gested estimate are, at present, unfortunately 
unknown. The user is cautioned accordingly- 

An arithmetic procedure was shown whereby 
the evaluation of a triple matrix product used 10 
brovide the multiple correlation estimate, Fa 
Could be reduced to the simple problem of mu 
tiplying two vectors together. To this end, ше, 
quantities involved and defined in the p г ocedur 
Should be listed and evaluated in the follow ine 
goder: А,К,Т, Ө, е, в, В, С, gC, ф, D, hD, B, BC’ ® 
finally (BC' }+ which is equal to R. 
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